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CHAPTER I. AN INTERPRETIVE SUMMARY OF THE INTERIM REPORT 
AN OVERVIEW OF THE INTERIM REPORT 

The purpose of the Interim Report is to present an integrative summary of the 
results of the Sustaining Effects Study (SES) based on the results reported to 
October 1980. A short summary of the questions asked and the findings follows: 

1. Who Receives Compensatory Education? 

It is clear, in terms of percentages, that poor children and educationally 

needy children are the principal recipients of Title I and other Coiijjiensa-- 

tory Education (CE) services* However, there are more non-poor than poor 
children, and more children achieving above an educational cut-off point 
.(such as performing one year below grade level) than there are children 
below such a level. The absolute number of children receiving CE who are 
non-poor and achieving higher than one year below grade level is greater 
than the number df children receiving CE services who fall below these cut- 
offs. Thus, while the trends are in the intended direction, there could be 
a much better operation of the selection pfuJess to assure that more poor 
children, and more educationally needy children receive CE services. Pos- 
sible_ improvCTeiLt s p a rt i all y d epend en a clarification of the intent of 
Congress regarding who should be served. 

2. What Is Compensatory Education ? 

This question cannot be answered simply. CE is an amalgam of many differ- 

f 

ent services delivered by diverse mechanisms. However, it is clear that CE 
students receive services that are to some extent different from those they 
would have received had they not been selected for CE services* CE students, 
relative to regular students, receive more hours of instruction in reading 
and math. This instruction is in smaller classes; more of it is in small 
^jroup settings, and more of it is given by special teachers and aides* The 
instruction is more varied/ involves different content and methods of in- 
struction, and more materials and equipment are used. While CE students 
have significantly more money spent on their instruction, and while they 
receive much more basic reading and math services, they lose out on some of 
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the instruction that regular students receive while the CE students are 
receiving their special instruction. 



How Effective Is Compensatory Education? 

Based on the results of data from the first year of data collection it 
appears that CE, and particularly Title I, is effective in improving the 
read, .g achievement of students in the first, second, and third grades. 
It is effective in improving the math performance of students in all ele- 
mentary grades. The amount of improvement relative to similar students 
who have not had CE services is not large, but it is statistically signifi- 
cant. \ 



What Happens to the Achievement of Students When Their CE r services Are 
Discontinued? 

There is considerable turnover among stutents receiving CE. About 40 per** 
cent of the students receiving Title I services in a given school year will 
not be receiving them the ensuing year. The figure is even higher for other 
fpris of CE. The data shows that students who have had their CE services 
discontinued do, in fact, receive services similar to regular students. 
This discontinuation of CE services does no^ seem to have a deleterious 
effect. Students who lose their CS services because * 



level which 'promoted then out* of CE continue to perform at their rela- 
tively higher level. 



what Happens to student Achievement Over the Su»er, and Is Summer School 
Effective? \~ 

Generally all groups of students continue educational growth over the simmer 
Blip growth is greater in reading than in math, there appears to be a \ 
slightly greater summer growth for regular students relative to CE students 
in reading but not in math. This is judged to be practically insignificant. 
In comparing students who attended turner school with students whcrdid not 



attend summer school, no increased achievement was evident. It is eqpha- 
sised that the Mount of instruction in reading and math in the typical 



summer school is quite small and it is probably unrealistic to expect much 
academic growth. 

2 
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These are the major results of the study based on current and completed analy- 
ses* In the sections that follow these results are given in more detail and 
^thei*. implications are discussed* So far the results of the study have been 
reported in the series of technical reports listed at the end of Chapter II. 
Each of these reports contains an overview which attempts to summarize the 
important findings of the Report, while the text proper consists of detailed 
data and its analyses. Generally, the technical reports do not contain exten- 
sive interpretive or policy -otiented discissions. It is the intention of this 
report to summarize the important highlights of * the reports, 'to integrate them, 
and to infer policy implications. Ae inference of policy implications is nec- 
essarily a somewhat speculative activity because, when done by a technical con- 
tractor, it reflects a limited perspective and one largely based on research 
data. Questions of congruence with other program objectives, and political 
considerations are frequently not adequately reflected J - a researcher 9 s think- 
ing and thus properly inhibit policy rec emendations . While the interpretations 
offered here need to be viewed as reflecting a limited perspective* they do have 
the distinct advantage of being based on factual data and its analyses. 

The results reported here are largely based on survey types of information col- 
lected at elementary schools during the 1976-77 school year. Later a final 
xeport will be prepared based on data collected over three consecutive school 
years and also on data collected in an * in-depth 1 study of 55 high-poverty 
schools , 

« 

In this chapter a statement of the problem as studied in each of the subsequent 
chapters will be given; there will be a suamtary of the data available, and then 
a discussion of the possible indications of that data. Each of the subsequent 
chapters contains a more detailed presentation, so written as to be of interest 
to policy makers, educators, and citizens seriously concerned about elementary 
education. Each of the chapters in this Report is based on the relevant tech- k 
nical reports, which are quite detailed and analytical in nature, and are in- 
tended primarily for technical researchers, but will be of interest to anyone 
concerned about the details of the data on which this Interim Report is based. 
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HIGHLi THTS OF CHAPTER II - INTRODUCTION 

This chapter begins with a short history of the SES, pointing out that it started 
in July 1975 and, after a year of planning and preparation, data collection was 
begun at 329 public elementary schools in the fall of 1976. Data Wfere collected 
for three excessive school years. Bach fall and spring all of the students in 
each school took a series of achievement and_attlfiaaa_taataj- .theirs t eeche rs 4j»»- 
die a ted the amounts and kinds ^pf instruction each child received in reading and 
math during the school year, and the teachers and principals reported on their 
own training/ characteristics, and methods of instruction. 

The data collected were all designed to help obtain answers to a . series of 
policy issues. The two major issues were: 

1) who receives Co^ensatory Education? 

2) Bow effective is Cospansatory Education? 

Related to these primary issues were a number of secondary questions i 
3Y what is Cos|>ensatory Education? 

4} what is the nature of the heme environment of alementary school students 
and how is it related to school achievement? ^ _ 

5) What happens to the achievement of students when their CE services are 
discontinued? 

6) Is there an optimum duration and period for receipt of CE services? 

7) What happens to student achievement over the summer and is summer school 
effective? 

The remainder of Chapter II discusses the design of the Sustaining Effects Study 
(SIS) , the various samples used in the study, the test and survey instruments 
usad to collect data, relations with the schools and how the data were collected 
the 1 in-depth* study of high-poverty schools, and the SES Report Series* It is 
believed that high quality data ware collected on a very large number of regular 
and CS students. The resulting data base constitutes the largest and most thor- 
oughly integrated body gf information about elementary education that has ever 
been collected. 



HIGHLIGHTS OF CHAPTER Tlx - *HQ RECEIVES COMPENSATORY EDUCATION? 

There are many kinds of Compensatory Education programs designed for different 
kinds of students. The sustaining Effects Study was mainly concerned with 
Title I of the Elementary and Secondary Education Act, but since Title I oper- 
ates in an environment which includes other CE programs it was necessary to 
consider both Title I and the other programs. Co n gress man d ated the ra it Irlp a'" — 
-tion study and specified that information be obtained on the mmfeer of students 
receiving and not receiving Title I services as a function of, first, the poverty 
status of the student and, second, as a function of the academic acljdLevement of 
the student. To obtain the economic status inform lion, home interviews were 
conducted with a random sample of about 15,000 parents of students in the study. 
The students all took achievement tests in reading and in math during the fall 
of the 1976-77 school year, which provided the necessary information on academic 
achievement . 

The results show that among students crating from a poverty* background, 40 per- 
cent receive CE services** and 60 percent do not, while for students coming from 
a non-poor background 21 percent receive CE services and 79 percent do not. In 
terms of the receipt of CE services it is clear that a greater proportion of 
poor students receive CE services than de non-poor students. However, because 
there are many more non-poor students than there are poor students, the number 
of non-poor students receiving CE services is greater than the number of poor 
students receiving such services (1,690,000 and 1,230,000 respectively). In 
the same population of students there are about 2,600,000 poor children not re- 
ceiving CE services and about 14,100^000 non-poor students also not receiving 
CE. To the extent that the Congress intended Title I and other CE programs to 
be programs for both the poor and the educationally needy, it seems that there 
are many poor children who are not served while at the same time there are many 
non-poctr children who are receiving CE services. 




*See Chapter ill and Report \1 (2) for a discussion of how poverty was defined. 

**These figures ar^sfor all CE. Generally the trends are the same for Title X 
and other CE, but there are some differences. For data on these differences 
the reader should consult Chapter III and the relevant technical report?. 



however, it is not clear that it was the Congress' intent that Title I vas 

largely to serve the poo r; rather it may be argued that it was the Congress.! _ 

intent to provide services for the educationally needy. Of those students 

whose achievement is one grade level or more below their assigned grade level — — 

_Ujowj^ieyars>>--^ pereent receive ^ seWices, while 54 percent do not re- 
ceive these services. Among those above this level of achi event (regular 
achievers), 19 percent receive CE services and 81 percent do not. But there 
are aany more regular-achieving students in the nation than there are low- 
achieving students, so there are about 1,750,000 students who are low achievers 
and receiving CE services, while there are 2,000,000 at that level who are not 

receiving CE services* Also there are 2,400,000 regular-achieving students who 

_> 

are receiving CE. 

Certain undesirable measurement problems are associated with using grade* . 
equivalent scores, so the data were also analysed in terns of percentilee. The 
percentage of students being served by d increases progressively as the achieve* 
sent percentile decreases. Nevertheless, among students above the national aver* 
age in achievement level, 23 percent are receiving some CE. In terms of absolute 
number* this Mans that there are about 1,200,000 students who are above the na- 
tional average in achievement and who are receiving CE. There are about 3,750,000 
students below the average who are receiving £1 services and 6,100,000 below the 
national average who are not receiving CE.* 

In judging the success of CE programs in reaching the intended students, one is 
faced with the ambiguity of Congress 1 intent. Some feel that CB^ programs are 
primarily for the poor and acme feel they are primarily for the educationally 

low-achieving, xt Is usually assumed that there is a high degree of relation- 

# 

ship between poverty and school achievement, and thus if one criterion is satis* 
fied, the othv will automatically be included. This is not the ease. The 
relationship between economic status and educational achievement status is very 
modest when viewed at the individual student level. If one knows the economic 



♦The nuabers presented depend on the definition of poverty and achievement level. 0 
With different definitions the numbers vary. See* Chapter III and Report #2 for 
rammers using differant definitions. 



status of a stuient one can predict his academic achievement somewhat better 
than at the chance level, but not by a very large amount (the correlation is 
\30). The relationship becomes considerably stronger at the school level (.67). 
While students are selected for CE as ^ndividuaTs, they must be in a school 
having CE funds. Thus, funding schools in terms of poverty cjf i ter ia tends to 

baXe CE available to the most educationally needy students. 

* 

When the joint relationship between poverty and achievement, and selection for 
CE are considered, the relationships become more complex. When all elementary 
school students are considered, then among the poor and low achievers,* 56 per* 
cent receive CE and 44 percent do not; among those who are non-poor but low 
aehievers, 43 percent receive CE and 57 percent do not; among the poor who are 
regular achievers, 33 percent receive CE and 67 percent do not* and among the 
non-poor end regular achievers, 17 percent receive CE while 83 percent do not. 
In terms of absolute numbers it is cleatf Chat a large mmtoer of students who 
are non-poor and regular achievers are receiving CE, about 1,750,000 students, 
while there are about 3,750,000 receiving CE in all the other categories* 

What do all these percentages and figures mean in terms of Congress 9 interest? 
irst, it is clear that in a general way the intent of Congress that Title I 
should go to the poor and the educationally disadvantaged is being met. 
It is the case that poor students receive Title I services relatively more ere-' 
quently thar do non-poor students* similarly low-achieving students receive 
Title I services relatively more frequently than do higher-achieving students* 
But because there are more non-poor students and there are more regular-achiev- 
ing atuuents, the absolute ntmfcer of children receiving Title I services is 
larger among both the non-poor and the regular-achieving students than it is 
afong the poor and lower-achieving* While the general intent of Congress is 
being met, there are ljurge numbers of students receiving Title I who do not fall 
within the intended target groups. 



•"Low" and "Regular Achievers" are defined here as being below or above one year 
below grade level. As discussed later, selection for Title I is based on a dif- 
ferent criterion* 
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There are * number of reasons for this apparent misassignment of students. 
Moat frequentlJ principals and teachers report that they use some combination 
of *sacher judgment and tests to select students for CE services* Both of tkese 
methods of ass ignment arm somewhat unreliable and #111 misclassify some students. 
Also, within a given school district, some schools will receive CE funds and 
others will no U Khen the students in a particular school are selected for CE 
some will, be selected who are less educationally new than are low-achieving 
students in other district schools without CE. Also, some schools can be desig- 
nated as 100 pefcent Title X schools and all matriculating students Will receive 
CE whether or not they need it. There are also significant regional differences 
in the distribution of achievement scores. Title I funds are generally distrib- 
uted to districts based on national poverty criteria, but the selection of stu- 
dents is based on local academic needs. At the school level the relationship 
between poverty and achievement is moderately high but is far from perfect. m 
Thus, since there are regional differences in achi eve m en t, some schools in higher- 
achieving regions will have the funds to enable them to select students for 
Title X whose achievement would be too high to be selected if they were in a 
region populated with lower-achieving students. 

Many analysts and administrators reviewing these data note that from the per- 
spective of the national academic achievement, the number of regular-achieving 
students receiving Title X is so large that the whole selection system should 
be carefully reexamined. Congress should be more definitive regarding the in- 
tent of the Title X program: if it is a program simply for the educationally 
disadvantaged it will be aimed at a different, but moderately overlapping popiir 
lation. The present selection system results, at the national level, in many \ 
children receiving Title X who, frora a national perspective, do not need it, an4 
at the sms time there are many children who need Title X but do not receive it* 
The solution to this problem requires a clearer definition of the intent of 
Congress* and probably the funding of a larger Title X program. As will be seen 
later, Title X does have a positive impact. on achievement and providing Title X 
services to a dd i tibnaf?educa tionally needy students can raise their levels of 
achievement. A better selection of students to receive Title X services would 
help, but even with the best selection system there are not enough funds to 
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serve all students who are below the national average. But, even at the present 
level of funding, a perfect selection system would allow the offering of Title I 
services to all who are one or more years below grade level. 

While 0 the relationships among poverty, educational achievement, and selection for 
CE constitute the major focus of Chapter III, other important findings are re- 
lated. In terms of selection for CE, Hispanics are selected relatively most 
frequently, followed closely by blacks, and then somewhat further behind by 
whites. This appears to be the proper order in terms of what we know about 
relative achievement. lr( terms of urbanicity, students from large cities and 
rural areas are, relatively,, selected most frequently. This is particularly true 
for the Title I program. Surprisingly, when all CI programs combined are con- 
sidered, the suburbs show the highest relative frequency of selection for low- 
performing students . This is because the suburbs offer a proportionately larger 
amount of services to students from other than Title I funds. This implies that 
if a student in the suburbs is low-achieving, the local conmunity or the state 
will find CE' funds to support extra service. In terms of regions of the country, 
the West and the Northeast have the highest relative selection rates of students 
for C^ services while the South and Mid-Atlantic have the lowest. However* the 
South is the highest for Title I but lowest for CE programs funded from other 
sources. These differences in regional and urban selection rates interact with 
the source of funding of CE services • National programs interact! with state and 
local programs, and the fairness of distribution of nationally- funded programs 
depends on whether one believes that on* region of, the country should benefit 
at the expense of another because of its relative poverty. 

There are sex differences in the rate of selection for CE. Boys receive CE 
services relatively more frequently than girls. However, this should not be 
attributed to ^ex-discrimination* It is well known that in the lower grades 
girls have somewhat higher achievement scores than boys and thus the boys have 
a somewhat greater need for CE tharr^irla. The differences in selection rates 
are Umall and it seems that the schools are not selecting students to receive 
CE services on the basis of gender. 



Pi Ally, Chapter III considers how students are selected for CE^as reported by 
prilkcipals and teachers. Tf&ge is a multitude of different methods used, but 
teadhejrs* judgments and test scores are used most frequently. The chapter 
closes with * discussion of how a targeting index might be developed, the idea 
is td| develop an index that would tell how well a sc**pol or district is doing 
in selecting; students for CS. A number of indices are considered and it is - 
concluded that it is feasible to develop such an index, depending on how com- 
preheiiiive it should be and how many resources are^available for computation. 
Technical Report #13 contains a table that sumarises the relevant features of^ 
each iAdtx end indicates how well it fulfills a number of requirements • 

r - * 

HIGHLIGHTS OF CHAPTER IV - WHAT IS COMPENSATORY EDUCATION? 

CE cannot be defined or described simply. It is an amalgam of many different 
program!, practices, and services. Chapter IV contains several descriptions of 
* 6E progtjsms. These qualitative descriptions support quantified material gathered 
f torn the| schools by the use of survey questions completed by school superinten- 
dents, principals, and teachers. From data collected in 1976-1977, we determined 
thalt for the SIS schools the average amount spent on the education of regular 
elmaenta^y students waa $1,189. For students receiving Title I services this 
basiip amiunt was supplemented by about $436, The exact additional amount is 
hard to determine because of the difficulty in determining precisely the number 
of stidents receiving Title I services, but the general magnitude of these fig- 
ures is illustrative of the size of the additional services Title I students 
receive. ! This additional money buys a considerable mix of different services. 

it amount of Title I funds pay for additional regular teachers, spe- 
i f aides, and other instructional personnel. Smaller, but signifi- 
es go for administrative services, training, plapning, and evaluation. 
X funds are used for instructional materials and audiovisual equip* 
well as for building alterations. Students receive guidance^ counsel- 
ilth, and nutritional services from Title I funds. In Chapter IV the 
J rorts of these services are given. 

* ' 

Knowing where the money goes if interestingV but one wonders what actual impact 
it has on instruction. In terms of the number of hours of reading and math in- 
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struction, Title I students receive more hours of instruction than regular 
* students in the same schools. In reading, in the first two grades, there are 
only Small differences, but as grade increases there are large differences. 
For example, by the sixth grade Title I students receive 6.6 hours of reading 
instruction per week, while regular students receive 5.0. In math there are 

significant differences in all grades, with Title I students receiving aljout 

if 

5.7 hours of instruction per week, while regular students receive about 4.9 
hours. These figures are gratifying in showing that Title I students actually 
receive more instruction in b^ic subjects, but there is another side to the 
picture. Jhe^length of the school day is the same for all, students and while 
the Title I students are*receiving additional reading .and math instruction, the 
regular students are receiving other instruction. For example, teachers report" 
that while Title l students are receiving additional reading instruction, the 
regular students are receiving instruction in reading, math or other subjects; 
are engaged in individual instruction; or are engaged in student-selected activ- 
ities. Thus, while Title I stMent* are getting more basic instruction, they 
are posing out on other instruction. Unless the number of school days is in- 
creased or the school day is extended for Title I students, this result £s in- 
evitable, and one woi)ders if the Title I r students are receiving a net benefit. 

Are there qualitative differences in the services delivered to Title I students? 
In terms of class size the data show that Title I, students are instructed in 
slightly smaxl.ur classes than regular students. o The size of classes varies by 
gradp, but for jx>th reading and ma*h arid for all grades, the Title I classes 
are smallur, with the average difference being about one student out of 19 in 
reading and one out of 24 i:. uukth. In the elementary grades, much of the in- 
struction is given in small groups ,-ather than to the class as a whole. This • ' 
is particularly true in the first two grades but, for reading, even in the sixth 
grade, 80 percent of the instruction is in groups rather .than the whole class. 
Title* I students receive much more *f their instruction in small groups. 

Possible, indicators of the quality of instruction include the number of students 
in a class and the size of the instructional group. These are" both favorable 
for Title I students. But probably more 'important are \e teachers and the 
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methods used in instruction. The teachers of Title I children tend to have 
lass teaching experience than do the teachers of regular students* This is 
true of their total years of teaching experience and of the length of tenure 

/ r- 

in their present school. However, the teacher*' of Title, I students tend to 
have had more college courses in Instructional techniques and more inservice * 
training. Both groups had similar amounts of total college training, in 
Report #10 it is shown that the single teatcher characteristic that is associ- 
ated with higher student achievement is the total amount of teaching experience. 
While the differences are not large, It is of concern that the teachers of 
Title I students have less teaching experience than the teachers of regular 
students. 

t 

4 

The seating in which Title I students receive their instruction is quite differ* 
ent from tfee setting for regular students. In both reading and math, Title I 
students receive c o nsiderably less instruction in the whole-classroom setting 
from regular teachers. In contrast, they receive more of their instruction 
from special teachers, teaching assistants and aides, in small groups, both 
within a umall part of the classroom or in some other room. Regular students 
receive more of their instruction from regular teachers in the regular class- 
room and they engage in considerably more individual * Aidy on their own. The 
major difference between Title I students and regular students is the differ- 
ence in the amount of instruction in small groups with instructional personnel 
other than regular teachers* 1b us, as researchers, it seems appropriate "that 
a. Tin. . .«-««. e*uu r~i« i-trotlSnWl w ■« « mi*. 
it would be preferable that the instruction be giyin by the regular teachers, 
since, as shown in Report #10, students seem to learn more when instructed by 
regular ^teachers. 

< 

We examined in detail the kinds of activities' and approaches used in teaching 
reading and math to Title I and regular students. There tended to be similar 
practices in the first two grades but then.lfrge differences appeared in the 
higher grades*. In generalising over the different activities, it appears that 
both the Title I and the regular students received instruction in basic subjects 
in the lower grades, but, as grade increases, the regular students receive 
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instruction in more abstract and advanced materials while the Title I students 
continue to be taught more basic -subject matter. The use of a number of dif- * 
ferent' approaches was examined, in the first grade, both Title I and regular 
students were most frequently taught reading through 'graded sight phonic analy- 
ses, 1 'graded letter sound relationships/ and 'literal and implied comprehen- 
sion. 1 By the sixth grade the methods -used to instruct the Title I students 
- were completely different from those used to instruct regular students, in the 
sixth grade, the three most frequently used methods with Title I students were 
the least frequently used with regular students/, and the three most frequently 
used with regular students were the least frequently used with Title I students, 
For the regular students in the sixth grade, the most frequent methods used were 
•literal and implied comprehension, ' 'reading in content field,' and 'literary 
forms and appreciation. ' In contras* the three most frequent methods used with 
Title I students were 'modified alphabet,' 'self instruction with reinforcement,' 
and 'student re ding own writing.' These were the least frequently used tech- 
niques with regular students. It is clear that the methods used with Title I 
students are different from those used with regular students. We recownend that 
experts in the teaching of reading should examine this data and see if they think 
appropriate methods are being used with Title I students. 

c 

There are also differences in the methods used in teaching math. Relative to 
regular students, Title I students receive more math instruction by 'learning 
about the structure of number systems, ' 'working with math games,' 'working with 
physical models,' and 'learning about sets.' Again we think this data should be 
examined to see if it is appropriate as thr content of instruction for Title I 
students. 

Finally, there are data on the uses of teaching materials and audiovisual equipment.. 
Title I students tend to receive more of their instruction from non-textual mate- 
rial and from audiovisual equipment. This is particularly true in reading. 

It is clear that Title I students receive instructional service's that are in 
addition to, and different from, the instructional services of regular students. 
But it is not so cl«ar that these services add up to a net positive effect, in 5 
theory, receiving, more reading and math instruction in small groups from instruc- * 
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tional personnel who can devote more individual attention to the Title I student 
should result in greater learning* but while the Title I student is receiving more 
reading* and math instruction the regular student is frequently receiving instruc- 
tion in a different subject or a different setting, but still getting something 
the Title I student is not. Also, the regular student is more frequently receiv- 
ing the instruction from a i^jular teacher with more teaching exper ; ence than the 
special instructional personnel instructing the title I students. 

After the first two grades, the methods and techniques ' used in instruction for 
the Title I student and the regular student differ. Title I students tend to 
be instructed in more elementary or basic material while the regular students 
are receiving more advanced and abstract material. The methods used with the 
Title I students in the higher grades are quite different from those used with 
regular students. It is not intuitively obvious that the methods used with 
the Title { students are the best methods that might be used. We believe cur- 
riculum experts should examine our data to see * f changes, should be rec o m mende d. 
It is also clear that Title I student* • teachers more frequently use noh-text 
teaching materials and audiovisual , aids . From results in Report #10 it is not 
clear that these materials are helpful; it is possible that they are used be- 1 
cause they are available an4 that they are available because there is Title X 
money to buy them. In the next chapter we will examine the extent to which 
Title I service* seem to lead to greater learning and we will attempt to deter- 
mine what factors lead to any differences obtained. 

\\ . 

HIGHUGHTS OF CHAPTER _V_^HOW EFFECTIVE IS COMPENSATORY EDUCATION? ~ 

This chapter examines two questions. First, it considers whether Title I stu- 
dents show gains relative to a comparison group of educationally needy students 
who do not receive Title I services. Second, it examines the evidence to deter- 
mine if therja are school practices, instructional techniques, staff characteris- 
tics, and organizational settings which are associated with increased educational 
achievement. | \ 
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There is a discussion of what is meant by 'Title I,* 'Regular Needy, 1 and 
'Regular* students.* Die problem of defining a student's status is not straight* 

•Brief ly , ^Tljtie I ' s tudents are selected to receive Title I services, 'Regular 
Needy' a tudefcts are students judged by teachers to need CE services but not 
receiving any, and ^Regular' students are not judged to need CE nor are they 
receiving any 
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forward, and it is pointed out that over a period of time a particular student 
may belong ^o each of the above groups. Because students frequently change status 
from one group to the other the composition of the groups changes , particularly 
at the beginning of the school year. Because the Title I and Regular Needy 
groups are composed of relatively low-achieving students, at the beginning of 
the school year these groups tend to lose their higher-achieving students as 
the better students are •promoted outr' to the Recular group . Similarly, the 
Regular group tends to lose its poorer students to the Title I and Regular 
Needy groups because in the Regular group the low-achievine students are re- 
placed by the higher-achieving students from the lower-ach_w Ing CE groups. 
Because of these changes in group membership there may be an apparent increase ^ 
in the achievement gap between Regular students and Title I and Regular Seedy/ 

students as grade increases. Likewise, the fact that there are fewer Title/4 

J 

students in the higher grades further increases the apparent gap, since 0e 
Title I students are generally the lowest-achieving students. If there/are 
fewer Title I students and they are the most educationally needy, then as their 
proportion of a class becomes smaller the average difference betweeii these 
Title I students and regular students will increase, ttius, the ^-called in- 
creasing achievement gap between Title I student/ and regular students is partly 
arti factual. 

Chapter V examines the evidence for achievement gains based on the data for one 
school year, the first year of SES data collection.* G*4phs are presented* that 
show the relative growth of Regular, Title I, and Regular Needy students. The 
evidence is quite clear in grades 1, 2 and 3 that the Title I students grow at 
a faster rate for reading than similar Regular Needy students. The Title I 
students do not grow at quite as fast a rate as the Regular students in grades 
1 and 2 but seem to grow at a slightly faster rate in grade 3. For grades 4, 
5 and 6 in reading, all three groups seem to grow at about the same rate. Thus 
we conclude that, for reading, Title I seems to have a positive effect in grades 
1, 2 and 3. but not in the other three grades. For math, the picture is consid- 
erably more positive. In all grades for math the Title I students inprove more 
than the comparison group composed of Regular Needy students. Furthermore, the 
Title I students appear to improve at a faster rate than the Regular students, 

♦Later technical reports and the Final Report will present results based on the 
three-year, longitudinal data. 
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while the Regular Needy students grow at a slower rate than the Regular student 
He conclude that Title I services have a positive effect in math at all six grade 
levels. / 



There if a discussion of the reasons why Title I may be more effective in math 
than in reading. Basically, it is suggested that reading is learned in addi- 
tional locations other than the school, such as the home and other non-school 
situations. On the other hand, math is largely learned in school. Thus Title I 
services offer greater relative exposure to math than is the case in reading. 

C hap ter V also e x a mines the educational practices and other factors that might 
be associated with improved educational performances. Among the factors inves- 
tigated were: student background variables, the amount and kind of instructional 
services, the type of school and instructional setting, the characteristics of 
instructional personnel, the characteristics of the instructional' environment, 
aM the characteristics of instructional practices. 



/ 



The effects of these variables were explored by a number of different techniques, 
such as regression analysis and causal modeling. Generally, the results were 
disappointing in the sense that there were not strong relationships between any 
of the school-related variables and increases in achievement. There were sons 
relationships that were statistically significant but not strong enough to 
clearly guide policy. The most noteworthy findings were* 

/e Greater experience in teaching is related to higher student growth in 



both reading and math. 

The amount of regular instruction and tutor/independent work shows 



positive, but modest, effects on achievement growth, in contrast, 
the amounts of instruction by special teachers or in very small groups 

does not often contribute to the explanation of achievement growth, and 

/ _ 

when it does, a negative relationship is observed * 

In both reading and math, temporary disruptions of instruction tend to 
be unfavorable conditions for learning in the upper grades but not in 
the earlier grades. * 
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• The frequency of feedback on progress sometimes relates positively to 
reading and msth achievement growth. 

e_In reading only, a tether's effort in plaxuiing and evaluation shows a 
positive relationship to achievement growth in some grades. 

In summarizing this chapter, the evidence indicates that Title 1/ services are 
positively related to achievement in reading in the first three/ grades and that 
Title I services are positively related to achievement in math/ in all grades. * 
As just discussed, sane educate nal practices are positively Related to achieve- 
ment growth. Noteworthy is the fact that students who receive instruction from 
more experienced teachers profit more than those receiving instruction from less 
experienced teachers. Also, instruction in the regular classroom setting seems 
to be a positive factor, ad does receiving instruction in/a setting without dis- 
ruptions . / 

i 

j 

Prom a practical point of view, the implication of the /finding that Title I can 
help students improve their performances in basic skills :\s that Title I services 
should be increased so that they might be available to all educationally needy 
students if our goal is to help all educationally needy students improve their 
achievement. Since only about half of all the needy students are now receiving 
Title I services this would require a very large increase in the amount of 
Title I funding. A political judgment is required as to whether the amount of 
gain is sufficient to justify this increased funding, but it is clear that a 
very large number of children who could profit from Title I services are not 
receiving them. 

The findings also suggest that educationally needy students should be the ones 
to receive instruction from the most experienced teachers in a regular class* 
room setting. At present this tends not to be the case. Title 1 students tend 
to receive instruction from less experienced teachers, and not in the regular 
classroom. These are matters that could be corrected at the local district and 
school levels. 
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these finding* are based on the analysis of the .first year data. We are pow 
analyzing the data from three longitudinal years. When these analyses 
finished we will be able to refine and expand the results reporter .n tttLs 
chapter* 




HIGHLIGHTS OF CHAPTER VI - HOW COST-EFFECTIVE IS COMPENSATORY EDUCA1 
It sees* reasonable that as sera and more resources are made available for the 



instruction of low-achieving students, the achievement of the students should 
incyfase. One of the assumptions underlying th# federal funding of educational 
urograms is that poor school districts are not able to Marshall though local 
resourc es to provide the jytra services that should help low-achieving students 
to iv?rove their performances. Tims it is hoped that the federal funds will help 
l^rove the performances of these students, we attempted to tfcst these assump- 
tions ,by investigating the relationship between the amount orj coat of resources 
used and changes in student achievement. The finding is that there is no posi- 
tive relation between the total cost of the personnel and other resources used 
in instruction and growth in achievement* Since this finding is contrary to 
conventional wisdom and the assumption underlying Title ll (and nany other social 
programs) , it deserves to be scrutinised carefully. 

Early studies of cost-effectiveness were usually based/ on obtaining the total 
expenditures involved in a d program and dividing thjm by the number of par- 
ticipating students. Otis gives a per-pupil cost, Mt there are many reasons 
why this approach gives untrustworthy results. In *n atteapt to ove rc om e the 
limitations of this approach, researchers have recently developed a resource- 
cost model based on the idea of applying a standard pries to each service actually 
received by students in their instruction^ This bottom-up approach, as contrasted 
with the top- dow n approach, starts with a teacher's report of how much instruc- 
tion each stttflmt receives. Standard prices ate developed for each element of 
instruction given. These prices are uniform for all students and thus ignore 
actual variations in teacher salaries and the cost of instructional material 
from one region of the country to another. The basic assumption is made that 
a teacher with a certain amount of education and te a ch i n g experience does as 
effective a job in one job location as in another. Thus a uniform, coamon met- 
- ric is developed and used to cost the instruction received" by each student. 
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Chapter VII reports the results of applying this resou rce-cost technique to the 
SES data. Achievement gains were related to the cost of instruction. Overall 
the results show that there is no significant positive relationship between these 
two variables. For some grades there seems to be a flight positive relationship 
but it is countered by other grades with slight negative relationships, in 
Report #7 detailed statistical tests are reported and the overall conclusion is 
that there are few statistically significant trends and, where they are signifi- 
cant, they tend to be negative. This negative correlation means that the more 
costly the services a student receives the less the achievement gain made by 
the student. 

It can be argued that the reason for the slightly negative relationships found 
is due to the fact that more resources are given to the more needy student? than 
to less needy ones. It is argued that the most needy students will have more 
difficulty in improving their levels of achievement than less needy students and 
thus the negative relationship found is determined by the nature of the students 
receiving the more costly services rather than the ineffectiveness of the in- 
crease in services. 

this Idea was investigated and it was found that lower-achieving students do 
receive more costly services than higher-achieving students, while the relation- 
ships are not strong they are at least large enough to support the idea that the 
negative relationship between cost of service and achievement gain is a function 
of the achievement level of the students being served. 

While it is possible to offer explanations for the negative relationship it is 
still important to ask why a fairly strong positive relationship was not found. 
The idea that increasing the tunding, and thus services to needy students , will 
lead to increased achievement is so pervasive and fundamental to federaily-funded 
programs that these findings need to be most carefully examined for faulty analy- 
sis. One way of checking the possibility that the results are due to a faulty 
resource-cost model is to undertake the same analyses using total hours of in- 
struction received by the student. The use of hours of instruction received is 
Independent of any cost model and in a sense is more basic than a cost-effective- 
ness analysis. Yet the results are the same as those found with the resource- 
cost model. 
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The resource-cost model used has been criticised by some researchers as faulty* 
tie believe these criticisms are not valid; nonetheless , the importance of the 
relationship between the cost of services received and gains in a-nievemsnt is 
such that we racoswsnd that an independent analysis of the SES data be under- 
taken*. Wa believe it is important either to confirm the results reported here 
or to clarify the methodological problems in such analySi^. 

HIGHLIGHTS OF CHAPTER VII * WHAT HAPPENS TO TBS ACHIEVEMENT OF STUDENTS WHEN 
THEIR COMPENSATORY EDUCATION SERVICES ARE DISCONTINUED? 

Compensatory education programs are designed to serve students who need addi- 
tional services to hel*. them overcome educational deficits. Particularly in 
Title I, the goal is to serve the post needy students. From year to year, the 
particular students to be served will depend on a number of factors such as the 
availability of funds for CI programs In specific grades and subjects. When 
students whose achievement levels increased during the year are considered for 
services the next year, it may bo that they have progressed sufficiently, in 
cosparison to otter students with lower achievement levels, to make them no 
longer educationally needy. It has been argued that, as soon as these students 
begin achieving at higher levels, they are promoted out of CE progra m s and thus 
lose the i^etus that has built up and amy fall bade to a lower level. 



in the Sustaining Effects Study we examined three questions related to this 
problem, first, we studied the frequency of changes in CI status in students 
receiving 9 services from year to yaar to see if it was frequent enough to 
merit attention! next we determined whether or not thers really was a change in 
the instructional services received by jitudents ones they had lost their & 



status; sad finally, we 



i whether those students losing their CE ssrvicea 



continued to achieve at a relatively high level or reverted to the lower lavel 
characteristic of CE students, the "findings are relatively claar* Among CE 
students thers is considerable change in status from year to year. Among Title I 
students, about 40 percent of the students who received Title I servicss in one 
yaar will not receive Title Z services the nsst year. There is even gf eater 
turno ver in other programs, for the other federally-funded programs, the turn- 
over figure is about 80 percant, and for state and local programs it is about 
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65 percent. Thus it is clear that there is a large amount of student turnover 
fro© year to year. Next we examined che hours a^5*co3resrof instructional services 
offered to regular students, to students Whose CE programs continued from one 
year to the next, and for students who had received services in one year but had 
their services discontinued for the second year. The results show quite clearly 
that regular students receive services costing considerably less than CE students 
and also that the students who had received CE services the previous year, but * 
were not now receiving then, got services that cost about the sane as thi cost 
of services for regular students, rather than the cost of services for CE students. 
Thus, we know that there are many students who have their services discontinued 
and that the service* they receive essentially revert to the kind of instructional 
services received by regular students. What happens to their achievement levels 
as a result of this change? The results indicate that those students who no 
longer received CE services since they were no longer qualified because of rel- 
atively high achievement continued to maintain relatively high achievement 
levels during the next year. In other words, there did not seem to be any dele- 
terious effect of their no longer receiving CE services. The policy implication 
of these findings is that there is really no great problem associated with the 

i 

turnover of Ct students who lost services because of high achievement. While 
it is undoubtedly wise to give administrators flexibility to handle the cases' of 
individual students judged to remain in need of CE services, there is not a na- 
tional problem of CE students being 'promoted out 1 and then falling back because 
their CE services were discontinued; 

HIGHLIGHTS OF CHAPTER VIII*- WHAT HAPPENS TO STUDENT ACHIEVEMENT OVER THE SUMMER, 
AIR) IS SUMMER SCHOOL EFFECTIVE? 

All groups of students show achievement growth- during the regular school year. 
But what happens to that growth over the summer? To what extent do students 
continue to nature even though they receive no formal instruction? we have al- 
ready seen that during the regular school year the rate of growth for compensa- 
tory education students is slightly less than it is for regular students. Some 
have suggested that during the summer regular students continue to, improve due 
to informal learning experiences, but that CE children lack both the motivation 
and resources to engage in these informal learning activities. However, the 
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evidence is 1ms than^clear-cut. Some have argued that, for all students* 
achievement suffers an absolute decline over the sumner; other evidence sug- 
gests that CB students euffer^a loss .relative to regular students^ It has 
been further suggested that among CE students those who achieved the highest 
gains during the regular school year suffered the sharpest losses during the 

Eased op these idea*, it has been suggested that suxmar school has an unusually 
i^ortat role t£ play. If CB students have regular school year learning experi- 
ences which enable thU to achieve hitfi gains, it is isportant that efforts be 
mde to continue this high rats of achi ev e men t, and summer school seam a rea- 



sonable way of doing itw Since summer school classes are available to only 
about half of all students , it has been argued that their availability should 
be increased, particularly so that they would be available to CE students. 



The qutstion of whether achievement levels increase or decrease over the 
' has i^lications for both 6&a evaluation of CB p r o gr ams ad for the wisdom of 
fading earner schools. Starting in 197S, a ssries of reports was publishsd 
that indicated that there was an absolute loss in achievement ovjr the suoer 
end that CB studats 1ms relatively sore than regular students, theme reports 
were influential in shaping federal thinking about the whole quation of the 
intellectual growth of CB students ad the Executive Branch's position on legis- 
lation to increase support for summer schools* Since then several reports have 
produced data which seemed not to support the co nc l us ions of the previous reports, 



Xn the Sustaining Bffects Study we were able to examine a large amount of high 
quality longitudinal data to evaluate thae contentions. The raults ere quite 
clear. Wot reading, there is not a susasr Iom but a consistent gain, for all 
grades ad all kinds of studsnts. for math, t%wce^ls also a simmer gain, but 
it ie not as large as it is for reading. It is reasonable to suggest that in 
• reading the studats have considerable exposure to reading material over the 
■i— sr. while for mth there .is less opportunity for summer learning, the ear- 
liar reports also suggested that there was a relative Iom for CE students in 
eesparlsoa to regular studats. Here the SBS results are las clear-cut. For 
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the non-CE students |n reading there is a decrease in the rate of growth over 
the summer for th* lower grade cohorts but very little, if any, for the higher 
grades. For. -the 4E students in reading there is a similar decrease in the lower 
grades, but considering their slightly slower rates of growth during the re 
year, there may bf slight summer gains reUtive to hon-CE students. In the 
higher grades the CE students in reading drop off slightly more than their non- 
CE peers. For math, the pictdre is somewhat different. Both the CE and the 
non-CE students show a lessening in the ^ratea of growth over the surmer for all 
grade cohorts. Hie change for CE and non-CE students is very similar with, per- 
haps, slightly larger drops for the non-CE students, in summary, the results 
^ shew that there may be a very slight overall relative sunnier drop . for CE students 
in reading, but not in math. Neithe^ the SES d£ta, nor data reported by NIE, 
-give credence to any large or particularly significant summer loss. 

' It'had also been proposed that CE students who were high achievers during the 
school year lost more than low .achievers , >^(ere achievement was defined in tez^s 
of the-lev*l of performance, not in terms af gains during the school year, the 
SES data show that low-achieving students^ntlnue to grow over the a timer and 
t ** about the same rate as during the school year, and dUre is no significant 
difference between CE and non-CE studexrt*. the ottter hand, high-achieving 
students grw at a faster rate during the School year. For reading, ndhrCE 
Mgh-achi*ving Students continue to grow over the sunroer, but high-achieving CE 
students show a loss, particularly a relative loss. Wor math, both CE and ndft- 
CE highrachieVing students show a lo^s over the summer, but thc|CE students have 
a larger loss. -\ 



lower 
gtfiar 



The importance to bfc attached *to this relative Ibss for high-achieving students 
depends on where the emphasis for CE resources should be placed. There are 
about six times 'as many. CE students below tthe national median in achievement as 
there are above it. If the goal is to heJ* the vast majority of CE 'students* 
canzone justify exceptional resource' e^cpenditures t&c high-achieving CE^tudehts 
on the ground* that they lose more over the sunnier than th^ir rflpn-^EF>eers? on 
the other hand, low-achieving CE students *§aii^ oyer ^ the softer, 
aehi-- ^ students would gain more if they had spteiaj^eummer services- 
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It has also been arguad elsewhere that those CE students who are high gainers 
during the school year suffer high losses during the summer. According to this 
argument these students need the stimulation of intensive instruction to achieve 
high gains and, lacking such stimulation duting the sumer, they lose more than 
those having smaller achievement gains. This idea was tested by separating those 
uho had high regular school-year gains and coaparing them with studuita whr had 
relatively snail gains* Cosparlsons were made for both, individual jptudents and 
for school classes having high and low gains, the results show that indeed those 
who had high school-year gains had quite high summer losses. But,, at t^e same 
time/* those who had low school-year gains had high su—r gains. In other words, 
the result demonstrates the regreasion-to-the-mean phenomenon. Because of mea— 
suremsnt unreliability, the individuals at the extremes of both ends of a dis- 
tribution tend to move toward the mean on any subsequent measurement. Thus the 
overall results are largely due to statistical artifact r 1 do not represent a 
real difference in gains or losses between high and low gainers. 



Frost this wealth of data we conclude that there is no absolute susmir drop-off , 
and that there my be a slight, but not particularly significant, relative loss 
for G2 students In comparison to non-CS students. 3Che more detailed analyses 
of 'high and low gainers, and of members of high-gain and low-gain projects, leads 
us to believe that reported relative mmmmr drop-off is more of a met surement 
artifact than a reality. 



The practical implications of these findings ^regarding the "susmer drop-off phen- 
omenon 19 are that it is not something that requires any special action or concern. 
Our findings, and those of others, do illustrate, however, that policy makers 
need to be vary careful regarding the soundness of reports and the appropriate- 
ness of any actions based on them* In* hindsight, it is difficult to understand 
why seme policy makers placed so much confidence in reports based on quite limited 
data which was expressed in a poor metric. 

The place of summer school in the general scheme of elementary education is not 



well defined. Some have suggested that students who have not performed well 
during the regular school year should go to simmer school as an additional learning 
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experience that would help them in the coming school year* I~ has been thought 
tha^xthA might be particularly important for CE students who are having diffi- 
culty kefep^ng up with their peers and; if high-achieving CE students lose a large 
amount of their school-year gains, it would-be particularly important that they, 
attend summer schoi>3 K< to Jielp mitigate such losses* Of course, summer school 
serves functions in add-on to instruction it\. basic subjects* There are i ec;:e- 
ational and apecial-interes^N^lasses that many students find attractive. Summer 
school can also serve as a "safe sftam$r haven .for children whose parents are work- 
ing or need to be away from hone. Summer^schooL serves otany purposes in addition 

T 

• to instruction in reading and math. 

About half of all students have summer school available oither^a<the students 1 
regular-year school or elsewhere in f-he school district, -with larger&shoola 
more frequently having summer programs. There is a slight tendency for *chodl^ 
having a high concentration of minority students more frequently to have tutomer 
programs. About two-thirds of all summer schools dei- jne support from Title I 
funds, but only a quarter are completely supported by Title I. The average length 
of these summer school sessions was five to six weeks, which is 25 to 30 school 
days. The amount of reading and math iiu? auction is not large. On the average, 
there are about 17 hours of reading instruction ^.J about 14 hours of math in- 
struction. There is ho difference in thm amount of instruction as grade level 
increases, nor do ^Title I students receive more instruction than others. However 
there -is a clear tendency for CE students to attend- summer school more than non- 

CB 'students. By grade cohort, the percentages of CE student *ho attend range 

y 

from 21 to 32, while che percentage* of non-CE students who attend range from 
7 to 20. _ In terms of judgment by teachers of need for CE services, twice the 
percentage of 'needy 1 students attend summer school than th* 'not needy. • In 



terms of achievement test scores, students attending summer school score consid- 
erably lower than the 
and non-CE students. 



erably lower than those not attending, and this is true among both CE. students 



In judging the effectiveness of summer school, it is not sufl^cient to show that 
students who attend summer school increase their performances over the sutfmer. 
Rathe*, o must compare students who attend summer school with similar students 
who do r p nt. First, we examined tfie summer growth of all the SES students <who * 
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attended sunmer school and compared their growth with that of students who did 
not attend. Ftfr both reading and math, the students who attended summer school 
grew at the same rate as those wto did not attend. Since these comparisons lump 
all student* together, it can be argued th* - the results^wquld be different for * 
Cfe students, so we made two other comparisons. In one case we compared only C£ 
students who attended summer school with CE students who did not attend. In the 
other sample we compared Title I students who attended summer school and were ' « 



from schools offering lumtr school, with Title I studentr who did not attend , 
suvier* school and were t jjchools which did not have sul er school. In neither 
case was there any evidence that students attending summer school performed 
better, the next fall thx* oiose who did not attend summer school. 

/ 

AH the analyses from the SES data discourage the idea that summer school, as it 
is nowWonducted, is an effective mechanism for improving the performances of/ 
Of students. As we compare students' who attended sumer schools with those who 
did not attend, we are simply finding that present summer schools are not ef f e * 
tive in raising basic achievement test scores. Wiat effect should be reasonably 
expected from four or five weeks of instruction of less than an hour a day for 
reading or math? When children are rapidly maturing in their reading skills 
and\can have staler reading experiences without summer school, should we expect 

-school -related reading gains? In the data there is a hint that sunmefr 
school inN&ie higher grades may be effective in math, and, in comparison to 
reading, theie is less summer growth in math in the highfer grades. Probably 
there is less opportunity for sunm^er math- related experiences than there are for 
reading. \ \ > # 

\ 1 

We should not conxwrue these results to mean that simmer school cannot be effec- 
tive. If summer school ^were monger, had more hours per day devoted to basic 
Subjects*, and had experienced regular .teachers, it might well result in achieve- 
meht gains for attendees, but that is still to be demonstrated. Indeed, we will 
never know how effective Sumner ttchool can be until a careful study is made of 
summer schools that are designed to give intensive instruction in the basic 
reading and math skills. If such summe* schools prove effective, then there 
wcu^d be a sound educational basis for legislation to provide funds for similar 
summer schools for CE students. 
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CHAPTER II. INTRODUCTION 

/ 

Sujwtary „ % 

This introductory diopter of the Interim Report starts with a short 
history of the Sustaining Effects Study. Next is a discussion of 
the pverall design of the study and of the way in which sample 
was selected. *Then ther*e is a description of the instilments 
(tests > questionnaires, form, etc J used to collect data. This 
is followed by a short consideration of how the data weir* collected 
and analyzed. The in-depth study of high-poverty schools is de- 
" scribed. Finally, there is a list of the reports issuing from the 
Sustaining Effects Study. " 

■ \ ' . 

A SHORT HISTORY OF THE SUSTAINING EFFECTS STUDY > m 

In March J.975 the U.S. Office of e Education issued a Request for Ptoposal en- 
titled "A Study of the Sustaining Effects of Compensatory Education on Basic 
Cognitive Skills." Soon the project became known as "The Sustaining Effects 
Study (SES).* The study was motivated by two major factors t one was a mandate 
from Congress 'and the other was the educational community 1 s concern over the 
effectiveness of compensatory 6<^cation (CE) . The Introduction to the Request 
for Proposal* said, 

, / v t 

/ N A near decade has passed since Congress enacted the Elementary \ 
and Secondary Education Act (ESEA) which authorized the Federal \ v 
Government t adjoin hands with State and local education agencies 
in a partnership designed to enhance 'the education of educationally 
disadvantaged children in areas with concentrations of children 
from low income families. During this period and under the authori- 
ty of this legislation almost fourteen billion dollars have been 
made available. These funds have affected the school jJLives of six " [ 
. ; to seven million children every year in" myriad ways. The evalua- 
tion requirements of this legislation have helped to create a 
national concern for the benefits that children derive from their 
years of schooling and for the costs of these efforts. 

Recently Title I of the Elementary and Secondary Education Act of 
1965 has been extended and modified in many important ways. In , 
particular^fche Educational Amendments of 1974 (|.L. 93-380) 
direct ttt£u.S. Commissioner of Education to 'expand his efforts 
tcidesOTibe the actut.l and potential recipients of Title I ser- \ 

* 
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vices and to evaluate the effects of such participation. The 
evaluative study proposed herein is both a response to these 
new requirements and -ah. outgrowth of prior experience in evaluat- 
ing Uiis program. " v . 

The Educational Amendment* of 1974 also instructed the National Institute of 
Education to undertake a ^eyies of studies which became known as "the NIE Com- 
pensatory Education Study;,"/ NIE was authorized to spend fifteen million dollars 
on those studies and entered into a number of contracts to study different as- 
pects of Title I coqpenjfat^ education. A list of the / studies is given in the 
NIE InterUi Report (14)/. /'In addition, the Department of Health, Education and 
Welfare and Jthe Department of Corinerce investigated ways in which poverty in- 
dexes could be update*! jflore frequently than every ten years through the census. 
Their report, "The h^aitfre of Poverty" (22) shows the impact^ that alternative 
methods of estimating/poverty would have on funding for different geographic 
regions. This study /anc the NIE studies had a shorter time frame than the 
Sustaining Effects study anc* the results have now been published (see (15) for 
the final report on the NIE studies) . _ 

i, 

' I 

Much of Congress 1 /concerr, regarding the effectiveness and operation of Title I 
stemmed from several evaluation studies which cast doubt on the effectiveness 
of compensatory education. Nargo, et (25) reviewed ^ number of evaluations 
conducted in the first five years of Title t and concluded that there was little 
evidence thit Title I had a positive i^act on participating students. -Subse- j 
£uent to that report, the Office of Education sponsored the Compensatory Read- 
ying Study (21) . While the results were more encouraging, they were limited in 
the nusfeer cf grades studied and in the, length of exposure of students to com- 
pensatory services; 

The first year of the SES (1975-76) was devoted to planning; to selecting the 
sa^le .and to* persuading schools to join the study? to the selecting, developing, 
and clearance of instruments* and to the formation ef various advisory groups. 
Data collection started in the fall of the 1976-77 school year and continued for 
three successive years. Dr, George Mayeske was the Office of Education Project . 
Officer during the first four years of the study and was succeeded by Dr. Jan 
Anderson in NovMober 1979. 
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Th3 PURPOSE OP TOE SUSTAINING EFFECTS STUDY 

The Sustaining Effects Study is concerned with a number of areas; there are 
two major policy issues and five secondary ones. The policy areas are: 

„ -\_^J^ Who receives Compensatory Education? Among children coming 
from different economic strata, how many receive Title I, 
other federal, or state, or local CE services? Similarly, 
among children performing at different achievement' levels, 
how many receive Title I, other federal, or state, or local 
. CE services? 

2) How effective is Compensatory Education? Do those students 
receiving CE services benefit from such services? What are 
their performance levels relative to students who do not receive 
CE services? Similarly, what are their performance levels relative 
to students who are judged to need CE but who do not receive CE 
services?* 

Secondary to these two issues are a number of related questions. 

3 > What is Compensatory Educatioh? Frequently we speak of Title I 
programs as though they had a cohesiveness of content -or method 
of instruction^ To talk about the ^effectiveness of CE, we should 
know what cfi^is. How does it differ from the instruction chil- 
dren would haye received if they had not been selected for CE? 
How does it differ frcp th£ instruction received .by students not 
receiving CE who are in schools where CE is offered? 

4) What is the nature of the home, environment of elementary school 
students and how is it related to school achievement? Questions 
2 and 3 above are concerned with school instructional programs 
and their effectiveness* Question 4 investigates the relation- 
ship of home environmental factors to school achievement. 
School achievement is examined as it relates to such factors 

as parents' educational and economic status, intellectual stimula- 
tion in the home, homework, and parents' involvement with the 
school. 

5) What happens to the achievements of students when their CE 
services are discontinued? CE services are discontinue^ for 
a number of reasons* After receiving CE services some stu-. 
dents improve to such an extent that, Relative to other needy 
students, they are no longer eligible to receive CE services. 
Other students have CE services discontinued for administrative 
reasons, such as their new classes do not ofier such services. 
Still others lose CBsservices because their schools no longer 
offer CE services. If students have been receiving CE services, 
but these service i aire discontinued due to one or another of the 
above reasons , w. happens to their achievement levels in sub- 
sequent years? 
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6) is there an optimum duration and period for receipt of CE 
services? It is sometimes argued that CE students need CE 
services throughout their elementary education. Others be- 
lieve that concentrating services in the first or secojid 
grade is most beneficial. Still other periods or durations 
receive support. What is tha optimum duration of CE services? 



7) What happens to student achievement over the summer and is 
summer school effective? there are a number of questions 
concerning how student achievement changes over the summer. 
Do regular and/or CE students experience an absolute or a 
relative change in achievement over the summer? Is summer 
school effective in increasing the achie vement s of regular 
and/or CE students? ' 

These questions will all be considered in the final report. Information on 
questions 1, 2, 3, 5, and 7 is presented in this report. 

THE DESIGN OF THE SUSTAINING EFFECTS STOP? 

TO obtain answers to the policy question* previously discussed it was necessary 
to obtain a large amount of data through a very complex design. The Sustaining 
Effects Stu^fonsisted of five substudies, which were* 

1. The Longitudinal Study. In the Longitudinal Study, educa- 
tional' achievmeent was assessed in the fall and spring for 
three consecutive yean. The children took achievement testa 
in reading and math, a functional literacy test, and a measure 
of attitudes toward school and toward themselves as ^students. 
The amount and nature of instruction in reading and ma|h was 
determined for each student lour times during the school year. 
In addition, teachers and principals reported on their prac- 
tices of instruction. Thus, ft was possible not only to assess 
student growth oVer a three-year period, but to relate €his _ 
growth, to the kinds and amount of instruction being received. 

2. The Successful Practices in aioR-Povertv Schools Study . This 
study identified and described the instructional practices and 
contexts that appear to beeffective in raising the reading and 
math achievements of educationally disadvantaged students. In 
the longitudinal study data were obtained by formal tests, 
questionnaires and schedules/ I* contrast, in the High-Poverty 
Schools Study, 1 in-depth* or ethnographic material was obtained 
from 55 high-poverty schools that were a part of the Longi- ; 
tudlnal Study sample. 
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3. This Participation Study , The purpose of the Participation Study 
was to determine, the relationships among economic status, educa- 
tional need, and instructional services received. The educational 
achievement of the students and the services they receive were 
obtained in the Longitudinal Study. - Measures of economic status 
were obtained in the Participation Study. A random sample of over 
over 15 , 000 students wa£ drawn from the schools and visits were 
made to the homes of these students. During the visits, infor- 
mation was collected on the economic level of the home, and on the 
parents* attitudes toward their children's schools and learning 
experiences . Thus, the level of student achievement and ser- 
vices could be related to the economic level of the home. 

4. The Cost/Effectiveness Study . Information was obtained on the 
resources and services to which each student was exposed during 
reading and math instruction. Cost estimates were generated on 
the basis of this information. Because the effectiveness of the 
instructional programs was determined in the Longitudinal Study, 

- it was possible to relate educational effectiveness to the cost 
of each program. 



5. The Summr Study. The Sustaining Effects Study also examined 
the effectiveness of ♦supmm -school programs. Information about 
the 1977 summer-school experiences of the students was combined 
with other data from the Longitudinal Study. The amount of 
growth over the summer was determined, as was the effect of 
attending summer school. ? 



THE SAMPLE FOE THE SUSTAINING EFFECTS STpy * 

The requirements of the sample for the/sustaining Effects Study had two some* 

what conflicting objectives. For ttye Longitudinal Study it was desirable to _ 

have a sample of schools and students %#ith a wide variation in the variables 
to be studied, such as the kipds/of schools, the extent of CE, the nature of \ 
the instructional practices, the kind of school leadership, the abilities of 
the children, and the level fit the funding. On the other hand, t#e Partici- 
pation Study required thaj/projections be made for the nation 1 s schools regard- 
ing the number of studejfCs receiving CE services, such as Title I. It was 
also necessary in the^articipation Study to report the nuofcer of students at 
various poverty levels who were receiving CE and to find the number of children 
at various levels pt academic achievement who were or were not deceiving CE 
services. Since ^ihe federal government was funding Title I programs at a level 
of about three pillion dollars a year, it was particularly important that the 
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study be able *o describe the effectiveness of Title I activities. To meet 
these requirements we formed three different samples $ a Representative Sample, 
a Co^>arisoa Sample # and a Nominated Sample- 

The Representative Sample. The Representative Sample was drawn to 
be representative of the nation's schools. It was a stratified, 
random saaple. Three stratification dimensions were used, namely: 
geography, size of the school district, and a district poverty 
index. The technical details describing how the sample of 243 
schools was drawn are reported In Sustaining Effects Study Report 
#1. In th&t technical report there are a number of tables showing j / 
ccuparisoos between the characteristics of the Representative Sam- 
ple of schools and tha known population characteristics. From 
ttMM comparisons , and from ths sanpling procedures used, it is 
concluded that the Representative Saaple allows quite accurate 
projections „of the characteristics of the nation* s •lementary 
school students. 

His Cb»arison Sample. In trying to assess the effectiveness of * 
CZ it would be desirable to be able to compare the achievements 
of OB students with otter similar students who were not receiving 
"-- CB. Us were able to locate 23 schools situated in high poverty 
areas which were not receiving. CB fqnds. These form the Compari- 
son Sample. 

The Nominated Sample, Since one of the major purpose? of the 
Sustaining Effects Study was to determine the effects of Title I, 
it was essential that the total sample of students contain a" 
large number of Title X students. Another purpose of the study 
was to determine those teaching practices which seemed particu- 
larly affective. Thus a Nominated Sample was formed which con- 
sisted of 43 Title I schools that wera thought by state depart- 
ments of education, the U.S. Office of Education, ancj other 
* agencies/ to be particularly good examples of effective CB practices. 

4a 



In the first year of the study there were 329 schools having about 120,000 stu- 
dents* As will be described later , data were obtained on each student in the 
school , thus there are data on regular students, Title I students, students re- 
ceiving Sther CE, affluent students and poor students, high-achieving and loW- 
achieving students, students with different racial backgrounds and, in short, 
all the different kinds of students that exist in the nation's elementary 
schools. (There were soon exclusions; excluded wire schools with instruction 
largely for handicapped students, students in bilingual programs, students in 
English-as-a-Second-Language programs, etc. these exclusions are described in 
Report 
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Originally it was planned to cohtinu^the study with all 329 schools throughout 
the three years of data collection. However the full funding of the project 
wau not available during the second operational year of ^the study, w^ich re- 
sulted in a reduction in the size cff the Representative Senile. During the 
first operational year we were able to collect all of the data that" were re- 
quired to make .the national pr jections -retired by the Participation Study. 
Since the analytical methods involved in the Longitudinal Study do not depend 
on strict representation, but rather that t^ere be as much variation as possi- 
ble in the variables being studied, it was decided to drop schools .from the 
Representative Sample and retain the other samples intact. Even though the 
Representative Sample was reduced by 60 percent it still remained a remark- 



ably representative sample, of the 120,000 students in the first operation 
year, about 70,000 remained in the study during the second year. Readers 
interested in the technical details of the sample should refer to Reports #1 
and #13. V 



The Data Collected and Instruments Used . To undertake a study as diverse as 
the Sustaining Effects Study it was necessary to collect information about the 
students, the kinds of instruction they received, their teachers , their school 
principal's philosophy of instruction and administrative practices, and des- 
criptive material regarding .\the school district. Table il-1 lists* the major 
instruments used, what was described* by each instrument, the person completing 
it, the frequency of administraCion, and the month during the school" year in 
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Table 11*1 

The Initrwinti Ottd in the Sustaining Effects Study 



Instnmwnt 



Describes 



Completed by 



Tistti Per 

Year 



Month 
Administered. 



Oomprshonelve Tests of Basic 
Skills 

Practical Achievement Scale 
Student Affective Measures 

ir Activity Slipeheet 

Compensatory Education Roster 

Student Participation and 
Attendance Record 

t-Teacher linkage Roster 



Teacher Questionnaire, . 
Section A 

fearer Questionnaire, 
Section 1 

Teacher Questionnaire , 
Section C 

Principal Questionnaire* 
Section A 

Principal Questionnaire, 
t Section B 

District Characteristics 
* Questionnaire Section A 

District 1 Characteristics 
Questionnaire, Section B 

District Expenditure Infor- 
mation Questionnaire 



Student 


Student 


2 


Sept/Oct Apr/May 


Student 


Student ' 


2 


Sept/Oct Apr/May 


Student 


Student 




Sept/Oct ,Apr/Hay 


Student 


Homeroom Teacher 




Marqh* 


Student 


Student 




Sept/Oct 


Student 


School Coordinator 




March 



Student > 
Student/Teacher 

Teacher/School 

Reading Program 

Mhth Program 

Principal/School 

School 

District 

Title 1 Program 

District/School 



Homeroom Teacher 
Homeroom Teacher 

Teacher 

Teacher 

Teacher 

Principal 

Principal 
Superintendent 
Superintendent 
Business Manager 

-y- 



Nov Jan Mar Ap 
Nov March 



2* 



February 

February 
February 
February 
February 
February 
February 



*Oct/Hov for the first year of data collection* 
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which it was completed. Most of the instruments used are compiled in Report 
#9A and the psychometric properties of the instruments are given in Report #9. u 



Each fall and spring every student completed three instruments: The Comprehen- 
sive Tests of Basic Skills, a Practical Achievement Scale, and a Student 
Affective Measure* The Comprehensive Tests of Basic Skills were administered 
in the fall and spring of each year to determine the student's achievement in 
reading and math. 

* T 

There has been considerable criticism of standard achievement tests. It is. 
sometimes claimed that they are biased against minority or poor students and 
also that they tend to measure academic subjects that are unrelated to real 
life situation?. To attempt to overcome the criticism of the academic nature 
of achievement tests, we developed a 9 functional literacy* test. This test 
was a picture test which presented pictorially a number of situations that 

ldren commonly encounter in their everyday lives* While viewing the' p^- 
tuie, students were asked questions about the situations pictured. This test 
involved both reading and math problems set in the /cdhtext of practical 
situations. It was administered to all fourth*, fifth-, and sxxth-grade stu- 
dents. Each student also completed a measure of attitudes toward school and 
toward reading and math. It > turned out that the scales of this instrument 



were so highly interrelated that it was* sensible to use only the total scale 
score. 

Once a year the teachers 'filled out a questionnaire. The first part of the 
questionnaire asked for demographic and general information. A second part was 
for reading or math a^d asked about instruction in that subject area, how stu- 
dents were grouped, how lesson plans were used, how instructional materials 
were used, what instructional methods were used, etc. Similarly, each Princi- 
pal reported on a set of demographic questions, as well as upon his or her 
philosophy of instruction, attitude toward discipline, efforts at coordination 
,of instruction, and similar items. The Principals also described their schools 
in terms of size, grade range, sources of funding , class assignment practices, 
parent participation, and staff training. Likewise, the district superintend 
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dent and the Winn manager completed questionnaires describing district 
instructional policies and expenditure information/ 

Two very i^ortant inetrumsnts were the Compensatory Education Roster and the 
Student Participation and Attendance Record. At each school .the Local Coordin- 
ator cosvleted the Co^ensetory Education Roster by indicating for each student 
whether or not the student was designated -to receive GB funded by Title I, 
other federal funds, state funds, district or private funds. This roster was ' 
isportant because it allowed us to classify students in terms of their CE 
status, A Student Participation and Attendance Record was filled out by each 
student's teacher, for reading and for oath; it reported the nunber of hours 
of instruction the student received in reading or math during a 'typical 1 week. 
The teacher also reported on the size of the instructional group and the person 
giving the instruction (homsroom teacher * special instructor, aide* tutor* etc*) 

The Student Backgrowd Checklist gives Information on such iteas as age* sax* 
race* previous education* grade* parent's education* parent's participation in 
school activities, student's participation in school lunch program* and re* 
ceipt of special services. The Sq—r Activities Slipsheet obtained informa- 
tion frcai the student on activities during the previous suT * such as whether 
or not the student went to suswr school* to camp* took a trip* etc. It also 
inquired about reading activities during the iwr. y / 

Interested readers should refer to sfcS Reports #9 and #9A for the psychomstric 
^characteristics and exact material contained in each of the instrumsnts de- 
scribed above. _ 

Data Collection . Because the aseunt of data to be collected was large and the 
araunt of time involved long* special stepe were taken to assure that quality 
data would be obtained. As soon as a school agreed to participate the princi- 
pal was asked to appoint a Local Coordinator who would be paid by SpC for his 
or her services. Frequently the principal acted as the local Coordinator but 
at other schools ths Local Coordinator might be the Title I director* the 
curriculum coordinator* or some other staff member. During the summer of each 
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..... . . 

year a training program for Local Coordinators was held which included in- * 
struction^n the procedures required in filling out the forms, administering 
tists, maintaining confidentiality, securing cooperation of the teachers, 
returning material to SDC, and similar matters. 
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Special steps were *ake©^o assure confidentiality. Number-Name identification 
rosters we* e ^retained at th«r school so SDC had no record of the names of any 
of the students in |he ^s,tudy. Because of these efforts ±o maintain confiden- 
tiality^ particular attention was paid to the maintenance of the linkage nusfcers 
for each student from year to year and also to link the students 1 numbers with 
their teachers' numbers. 

High Pover ty Schools' Data Collection . It is> often argued that information from 
formal tests, questionnaires , i and standardized forms do not give a real under- 
standing of the capabilities of students or of the school or institutional 
settings. Certainly the more intimate details of classroom instruction are 
not captured, in an attempt to overcome this problem, 1 in-depth 1 dita were 
collected at 55 high-poverty schools. High-poverty schools were desir- 
able because they had the highest concentrations of -CE ^students > the atu-* 
dents with whom the Sustaining Effects Study was most concerned. Teams of 
t*o observers each visited the 55 schools twice. The purpose of the first 
visit was to become acquainted with the school setting, to make arrangements 
with the» school principal and the Local Coordinator for a subsequent longer 
visit, to become familiar with the school organization, and to have a preliminary 
meeting with the teachers whose classrooms would be observed. The, second visit 
lasted for two weeks and involved the collection of ■ information in a'nusfeer of 
areas including instructional practices in the second and fifth grades. At 
each school a lengthy interview was conducted with the principal and each of 
the involved teachers. Classrooms were visited, and the way in which instruc- 
tion was conducted was noted. The teaching techniques used were recorded. ' 
Period axiy a count was made of the number of students exhibiting on-task 
behavior. Much of the material was recorded on prepared^ forms, but lengthy 
narrative descriptions were also recorded on audio tape. .The data collected 
by the in-depth techniques win be combined with the more traditional data 
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which had bean collected for the Longitudinal Study and results will be in- 
cluded in the SES Final Report^is\well a% in Technical Report #16. 
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THE SUSTAINING EFFECTS STUDY REPORT SERIES 



The detailed results of the Sustaining Effects Study are contained in a series 
of reports. These reports contain tables giving very extensive details about 
^11 of the data collected during the study frosi thousand* of students in 329 
elenntary schools. In addition to the \detailed data, the reports* include the 
results of various statistical analyses. \ The report series will be made up 
of the following volumes: \ 
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Repofct Number 

1. "The Saaple for the Sustaining Effects Study and Projections 
of Its Characteristics to the National Population" by Hoepfner, 

Wellisch, J., and Zagorski, H. (Published) 

2. "Students 9 Tfr M ~ l ~ and Educational Status and Selection for 
Omvensatory Edupation" by Breglio, V. J. $% Hinckley, R. H.< and 
Seal, R. S. (Published) 

3. "Students* Economic and Educational Status and Receipt of Com-* 
| pensatory Education" by Hincklfy, R. H. , Beal, R. S., and 

I Br*glio, V* -tf v ' (Published) . ^ 

4. "Student Bom Enviroimmnt , Educational Achievement, and Com^ 
pensatory Education" by Hinckley, R. H* (Editor) . (Published) 



> 



5. "The Nature and Recipients of Compensatory Education" by 
Wang, M. , Hoepfner, R. , Zagorski, H. , Hemenway, J. A., 
Brown , D. S. r and rfear, M. B. (Published) 

/ - ■» ' . 

6. "Resource Analysis of Compensatory Education" by Haggart, S. A., 
Klibanoff, L. Susner, G. S*, apd Hilliams, R. S. (Published) 



7. "An Analysis of the Cost and Effectiveness of Compensatory 
Education" by Sumner, 6. C, Klibanoff, L. S. and Haggart, S. A* 
(Published) 

8. "Summer Growth and the Effectiveness of Susmmr School." 
(At the printers) 

9. "The Measure* and Variables in the Sustaining Effects Study" 
by Hemenway^, J. A., Wang, M. , Kenoyer, C. E., Hoepfner, R. , 
Bear, M. G. , and Smith, G. (Published) 
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9A. "A Compilation of the SES instruments" by the SES Project 
Staff. /(Published) 

J ( ■ - 

10. "Student Educational Development During the School Year 
and the Effects of Compansatory Education" by Wang, M. , 
Bear, M. B. , Conklin, J. E. aad Hoepfner, R. (In second 
draft) * 

% * 

11. "The 4 ..acts of Discontinuing Compensatory Education Ser- 
vices" by Kenoyer, C. E. , Cooper, D. M. , Saxton, D. E. and 
Hoepfner, R. (At the printers) _ 

12. "Longitudinal Effects of Compensatory Education on Educa- 
tional Growth. r (Analysis underway) 

IS. "A Collection of Supplemental Reports from the Sustaining. 
Effects Study" by Hoepfner, R. ^Editor) (In final editing) 

14. "Achievement Growth ^n£ Duration of Receipt of Compensatory 
Services." (Analysis plan developed) 

— ... ^ * 

15. "The Characteristics of Students, Teachers, and Services 

** that Affect Achievement Growth." (Analysis plan developed) 

16. "Successful Pactices in High- Poverty Schools." (Analysis 
i& underway) 



17. N A Study of Students in Junior High School Who Had. Been 
Title I Students in Elementary School." (Dat? collected) 

18. "A Narrative Description of Compensatory Education.* 
(Data collected) - 

19. The Final Report of the Sustaining Effects Study. 

,20V Glossary of Terms and an Index to the Sustaining Effects 
Study Report/ Series . 



/ 

/ 
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CHAPTER III. WHO RECEIVES COMPENSATORY EDUCATION? 



Swrmxry - ^ - 

Based on economic data gathered by home interviews and achieve- 
ment data based on achievement tests, it was^possible to deter- 
mine the percentage and number of students receiving Title I and 
other CE services in terms of poverty and academic achievement 
classifications. The results show that: 

-# 

0 Among economically poor students 40 percent receive 

CE while 60 percent do not. Among the non-poor students 
21 percent receive CE while, the remainder do not* 

0 X Since there pre many more non-poor students than there 
are poor students, thq absolute number of non-poor 
students receiving CE is larger than the number 

_ ._ poor stuaenjbs receiving CE* There are about 1,230,000 

poor studerits and 1,693,000 non-poor students receiving 
Titte I. - 

# Therte are about 2,500,000 poor students who do not re- 
ceive any CE. 

0 Among low-achieving students 46 percent receive CE 
while 54 percent do not. Among regular-achieving stu- 
dents 19 percent receive CE* 

0 Since there are many more regular students than there , 
are low r aohieving students, the absol ite number of 
low-ac^peving students receiving CE is smaller than 
the number of regular -achieving students receiving CE. 
There are about 1,200,000 low-achieving students and 
l,300,QO0 regular-achieving students receiving Title I. 

0 When considering students who do not receive CE, we 
find that there are about 2,000,000 low-achieving stu- 
dents yho do not receive any CE* \ 

/ <*\ 

0 Number* are presented which show the joint distribution 
of CE pel^ation, economic status and achievement status. 
Among the! poc. and low achievers, 40 percent receive 
CE while\6Q percent do not. Other comparisons show that 
there axis significant numbers of non-poor, regular achievers 
who receive CE. 
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0 The results show that the highest proportion of CE 
recipients are Hispanic and black, are in large 
frCtiee and rural areas, are in the West and Mid- 
Atlantic regions (although if only Title I is con- 
sidered the Icygest proportion is in the South). 

0 Schools arm selected for.CE funds by a matter of 
different criteria tut the most frequently used 
are free or reduced-price lunch counts and/or AFDC 
-enrollment. Within schools students are meet fre- 
quently selected in terms of teachers * judgments or 
test scores. 

e Several targeting indexes are presented which mea- 
sure the efficiency with which schools select stu- 
dent* for CE. 

INTRODUCTION 

Title I of the Elementary and Secondary Education Act was first authorized and 
funded in 1965; by I960 it is distributing over three billion dollars annually. 
Tijtle I funds are received by all the states and by 96 percent of the nation's 
school districts. As McLaughlin (13) points out, the original Title I author- 
ization was supported by a mixed and powerful constituency. Those whose major 
concern was with poverty and ways of alleviating it believed that the funds 
would go to poor schools and district* and thus help the poor. Those who were 
principally concerned with improving the education of low-achieving students / 
felt that the funds would help such students and thus they supported the Title I 
program. It was assumed that there was a close relationship between poverty 
and low educational achievement. McLaughlin makes th^ point that 

■ Senator Robert Kennedy did not share the general euphoria that 
pervaded Washington when che 1965 Elementary and &coqd&ry Education 
Act (ESEA) was ratified. ESBA was enacted with high hdpes (or 
benefiting disadvantaged children. Title I of that act/xM-ch 
targets more than $1 billion a year to. 'meet the special educational 
needs of educationally deprived children, 1 was the particular N:ause 
of excitement and self-congratulation on the Hill. It had broken, 
through the long-standing opposition to federal aid to education 
and was viewed as an effective way to 'break, the cycle of poverty. ' 
Lawmakers were confident in 1965 that schoolmen knew what to do 
with the added resources, and that they would thereby establish 
effective compensatory programs for poor children. ' Title I was 
perceived as a central part of President Johnson's War on Poverty. 
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Reports from some of Senator Kennedy's constituents, however, coun- 
selled' against 'spcTT optimum." He concluded that some schoolmen 1 
might not use the new Title I dollars in the best interest of poor 
children unless the act included some way to insure that they would 
not be cheated of the special attention intended by tftie legislation." 

Those who were mainly oriented toward poverty considerations were able to 
specify * funds-allocation formula in such a way as to assure that the money 
was spent in poor districts and schools. Funds are first allocated to states 
as a function of the number of poor families in the districts of the state, 
the number of mothers receiving assistance under Aid for Families with Depen- 
dent Children, the number -of ne glee tea and delinquent children in schools and 
institutions, and several other poverty-oriented considerations. Based on the 
amount of money received the districts select schools to receive money or re- 
sources depending on various poverty criteria. However, at the school levex 
the criteria for allocating resources to students become clouded because of 
the need to conridar what other resources the school. is r^^iving, say from 
ESAA, or from state programs. However, those concerned with poverty could oe 
quite pleased that Title I funds were targeted toward the poor communities 
throughout the nation. 

There was, however, an important minority that felt that the -targets of Tit?* I 
funds should be cJ>4JLdren with low educational achievements. After all, Title I 
was an educational program. Was the assumption that there was a high correla- 
tion between economic need and educational need really true? By 1974 this 
argument had enough force that Congress decided that there should be a study to 
determine the economic and educational status of students participating in 
title I programs. In the Educational Amendments of 1974 Congress mandated the a 
Participation Study, by saying: 

"In the case of programs and projects assisted under Title I of the 
Elementary and Secondary Education Act of 1965, the report under 
this subsection shall include a survey of how many of the children 
counted under Section 103 (c) of such Act participate in such 
grams and projects, and how many of such children do not, and a 
survey of how many educationally disadvantaged children partici- 
pate in such programs and projects, and how many educationally dis- 
advantaged children do not." 
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While Congress specifically authorized a study focusing on Title I students , 
Title I operates within a school environment of other compensatory education 
progress as well as the regular school program. The general idea is that com- 
pensatory education (CE) consists of instruction in addition £o regular in- 
struction. It is given to students who have received the regular instruction 
program and are having trouble progressing at the expected rate. But as soon 
as one gets fro* the general concept to specifics, troubles arise. How does 
one judge that a student is not progressing at the expected rate? Also, there 
are many special program* in addition to -he regular program. Which are the 
CE programs? There is Title I, Follow through, English as a Second Language, 
Services to Migratory Children, Services to Handicapped Children, the Emergency 
School Aid Act, Programs for American Natives , special, state programs, special 
district programs, etc. Are all of these C2, and are the different activities 
funded under them properly called; CE? in Chapter IV we will describe the CE 
instructional program. For the purposes of tkim Chapter, CE is defined as an 
instructional program providing services to low-achieving students that are 
different from, or in addition to, the services provided to regular students . 
While this definition seems straightforward, it has a number of difficulties 
when applied to individual students and programs. The interested reader may 
refer to Report #9 (p. 69 ff) for discussion of the problems we encountered 
when we tried to determine which students were CE students. 

In the participation Study we were mainly concerned' with the Title I Program 
but we also had to consider other programs. Frequently Title I > students re- 
ceive services from several programs. Also, the nature of the Title I program 
v in a school is affected by the other programs in the school. All of these con- 
siderations affected' the design of the Participation' Study. 

THE DESIGN OF THE PARTICIPATION STUDY 

The basic idea of thi Participation Study was to determine the number of child- 
ren in the nation's elementary schopls Who were receiving Title I services and 
came from poverty families, and also to see how many children were from poverty 

Q 

- families and were not receiving Title I services. In other words we were to 
determine the relationship between receipt of Title I and poverty status. 
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Similarly, we were to determine the relationship between receipt of Title I 
and educational status. In the law authorizing * the study, Congress defined 
poverty in the same terms as those used to determine poverty for the allocation 
of Title I funds. They also defined students as being educationally disadvan- 
taged if they were one or more years below grade level. Thus, to undertake 
the study we had to dp three things : 

1. Obtain a sample that was representative of the nation's ele- 
mentary school children. 

2. Determine the poverty status of the families from which the 
children came. 

3. Determine the educational status of each of the children in the 
the sample. 4 

¥ 

i 

The Sample and Home Interviews, J 

To determine the poverty status of the children in the sample it was necessary 1 
to conduct a home interview with the parents of each student. Since home inter- 
views are expensive, we hfed to balance expense against the desired accuracy / 
of the nationar'projeetions to be made as a ^result of the home interviews. It 
was decided that a representative sample of 15,000 parents would be interviewed. 
It will be remembered from Chapter XX that one" of the samples for the Longitu- 
dinal Study was a Representative Sample* This sample included 243 schools that 
were representative of the nation's, elementary schtools. A random sample of 
students was drawn from each of these schools^ Interviewers visited the parents 
of these students and asked a series of questions regarding the economic status 
of the family, the attitude of the parents regarding their children's school 
and the education they were receiving, the $mount of time the child spent doing 
hom ew ork, the extent of parental assistance with school work, the child's 
leisure activities; and other educationally related questions. For jx full dis- , 
cussion of the sampling procedure and the content of the home interview the. 
reader is referred to SES Report #2. 
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The Determination of Poverty Status 

Baaed on the data collected during the home interview, an index value was com- 
puted for each child in the sample. The Orshansky inaex is a measure based on 
a family's Income, size, a<$ul£^child composition, and farm-nonfarm status. It 
is the official index used by the federal government in connection with its 
po v e r ty programs and in the allocation of Title I funds. 

The Determination of Educational Status 

In connection with the Longitudinal Study,, the Comprehensive Tests of Basic 
Skills in reading and math were given ta every child in the sample. * Since the 
sample for the Participation Study was a subsample of the sample for the Longi- 
tudinal Study, these achievement test scores were available for each student. 
Congress had def ined educational disadvantagement in terms of grade equivalents 
a measure that has several psychome tr ical ly undesirable characteristics. As a 
result the grade equivalent score for each student was determined, but we also 
ascertained. the percentile score and vertical scale score for each fitudent. 
More details regarding the determination of educational status <?an be found in 
SES Report #2. 

ECONOMIC STATUS AMD SELECTION FOR COMPENSATORY EDUCATION 

Congress wanted to know several things. It wanted to know, from the population 
of poor children, how many were receiving CB services and how many %mre not. 
It also wanted to know how many students were receiving CE services who were 
hot poor. Whether or not a student^came from a family that was poor was deter- 
mined by applying the Orshansky inde~ to information collected during the home 
interview.* Table III-l shows both the percentage* of -students receiving CE 
when classified as poor or non-poor and also the 'estimated total numbers of 
such students. Note that students are* classified as receiving. Title I and/or 
Other CE, Other CE only, no CE at a school having 4 CE, or no CE at a school 
which does not offer CE. 



*AFDC was also includes. 
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Table Ill-l \ 

Percentage and Number of Students Receiving Various 
CE Services by Family Economic Status f 







CE 


Status 






Economic Status 


•Titl I or Title 
and other CE 


I Other CE 
only 


No CE at 
CE School 

S — 


No CE at r 

Non-CE School Total 


Poor 


29% 


11% 


53% \ * 

\ 




100% 


Non-Poor 


11 




64 . 


16 

■ * 


vd . 






Number of Students , 


— . — ^ • 




Poor 

* 


1,230,000 


443,000 

* 


i 

2,199,000 


309,000 


4,181,000 


Noiv-Poor 


1,693,000 


1,551,000 


10,065,000 


^2,516,000 


15,82^,000 


Total 


2,923,000 


' i, 994, 000 


12,264,000 


2,825^000 


20,006,000 



What nessage can be drawn from thi^ table? The interpretation of the numbers 
varies depending on one's expectation as to whether or not CE should go pri- 
marily to povferty^level students* Forty percent <5t all poverty*level students 
are receiving sone kind of CE, .feut_21 percent of the non -poverty -*level students 
are. also receiving 7 CE. One can reflect that, percentage- wise , twice aft many 
poverty-level students as non-poverty- level students are receiving CE, But in 
tens of the total number of students, there are about 16 mi2 lion , non-poverty- 
level students and about four million poverty-level students; of these, there 
are about 1,690,000 non-poverty-le*el and 1,230,000 poverty- level iptudents 
receiving Title I, 13ms , there are actually more non-poverty. level students 
receiving Title I than there are poverty students. Or to look at tfie other 
side of the coin, 60 percent of the poor students and 80 percent of \ the non- 
poor do not receive Title I. In terms of the total number of students, about 
two and one half million poor students are nbt receiving CE, while ai^out twelve 
and one half million non-poor students are also not getting CE. Roughly speak- 
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ing, there are about 1<7 million poor students receiving CE, and about 2.6 
million poor children not receiving it* In brief, in absolute numbers, there 
are somewhat more non-poor than poor students receiving CE. (These figures 
are for Title I 4 and Other. CE combined. The picture is similar far Title I a 
considered separately.) 

Xe this bad? It depends on what students one thinks should be targeted to 
receive Title I services, temember that the funds <jo to poor districts and 
schools, but the individual ' students selected to receive Title I services are 
selected on the basis of educational need, not in terms of economic status. 
hXpo$ the definition of poverty is, such that only the lowest £l percent of the 
students are classified" in the poverty group. On* might speculate that the 
vast majority of those receiving CE and classified as non-poor aire just above 
that poverty level. Table III-2 indicates tht t this is not the case. 

It jlll be seen that there is a regular progressive decrease in the percentage 
of students receiving Title I services as family income increases. A similar 
but less marked tendency is evidenced by the numbers for "Other CE only." 
Since Title Z is more of a poverty program than most other CE programs this 
is the relationship we would expect to see. However, the idea that non-poverty 
students selected for CE are hovering just above the poverty line is dispelled 
by the table. Clearly there are significant percentages of CE students who 
are not in the two lowest fifths of family income. As will be seen in the next 
section, the correlation between student income status and educational achieve- 
ment status is relatively low. Thus, to the extent that students are selected 
for CE programs! on the. basis of their educational need, we would expect many 
of those selected t^ come from non-poor families. 

POVERTY AID THE CHAR ACTERISTICS OF STUDENTS SELECTED FOR CE 

We have already seen that proportionately more^poor children than non-poor 
children are selected for CE. What about some ot the other student character- 
istics, such as race, urbanicity and region o( the country? Sometimes it is 
thought that CE programs are primarily for black children in the ghettos of 
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Table III-2 



Percentage and Number of ^tudents^fcc4 ivlng" Various CE 
Services by Family Income. 

















Title- I or 






No CE at 


- "No CE at 




Title I and Other CE 




a CE 


a Non-CE 


Family Income 


Ot-ho-r CP 


Only 




School 


School i 


Lowest Fifth 


37% 


21% 




17% 




Second Fifth 


24 


27 




18 


is 

Xv 


Third Fifth 


17 


21 




20 


22 


Fourth Fifth 


ii 


16 




22 


22 


Highest Fifth 


8 


14 




,23 


25 






Number of Students 






4 

Lowest Fifth 


1; 090, 000 


428,000 


2, 


070,000 


360,000- 


Second Fifth 


702,000 


534,000 


2, 


226,000 


514,000 


Third Fifth 


507,000 


427,000 


2, 


460,000 


616,000 , 


Fourth Fifth 


390,000 


320,000 


2,695,000 N - 


616,000 


Highest Fifth 


234,000 


285,000 


2, 


813,000 


719, ^ftp 


Totals 


2,923,000 


1,994,000 


12, 


264,000 


2,825,000 



* 0 

large cities. As can be seen from Table III-3, that is not the case. If we 
combine the nujnber of students receiving CE under Title I and from other CE 
funds* we wee that, among poor whites, that 37 percent receive CE; among poor 
blacks, that 40 percent receive CE; and among poor Hispanics; that 47 percent 
fiave'CE services. At, the same time we find for the non-poor that 19 percent of 
of the whites, 27 percent of the blacks and 44 percent of the Hispanics receive 



♦From the point of view of equallfV of services, it is not quite appropriate 
to add together those receiving Tifele I and those receiving CE service funded 
from other sources. The costs of service under "Other CE only" is about jl 
quarter less than under Title I. 
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CE. Looking at the* poor and the non-poojc .together, we see that proportionately 
somewhat fewer whites than blacks, and somewhat fewer blacks than Hispanics re- 
ceive CE. There are« however, classification problems in presenting the results 
in this fashion. Although we instructed the teachers not to count those partici 
pating in bilingual programs as CE students r *« suspect that some teachers did 
so, and this accounts for the relatively high percentage of Hispanic students 
listed in the "Other CE only" category. Likewise, among the non-poor, it is 
probable that the blacks and HispAnics are lover in the economic status scale 
than are the whites, and thus more near-poor blacks and Hispanics receive CE* 
thus, it seems probable that about -the same proportion* of bla .xs and Hispanics 
receive CE and that somewhat more of them, relatively, receive CE than whites. 

Table III-3 

■ ' ^ 6 \ - 

Percentage of Students Receiving Various CE Services 
' by Family Economic Statue and Racial/Ethnic Group \ 

[ V 



Economic 
and Racial/ 
Ethnic Status 






CE Statu. 


— ^ . 




Title I or 
Title X and 
Other CE 


Other CE 
Only 


Mo CE 
at CE 
School 


No CE at 

Non-CE 

School 


Nunb«r* of 
Student. 


Poor and: 












White 


27% 


10% 


55% 


8% 


{ , 2,011-000 


Black 


33 


9 


51 


7 


1,501,000 


Hispanic 


29 


18 


51 


2 


- 556,000 


Other 


38 




35 


20 


113,000 


Mon-Foor and: 








f 


» 


White t 


9 


10 


65 




13,546,000 


Black 


19 


8 


55 


18 


' 1,266,000 


Hispanic 


24 




54 • 


5 


696,000 


" Other 


S ■ 


5 . 


43 


47 


3^.7,000 


Total 


2,941,000 


2,000,000 


12,264,000 


2,801,000 


20,006,006 

• * 
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As already noted, it£ is frlequuently thought that CB is a program for students 
in large city ghettos. Tafrle Hit4 shows that this is not the case, although 
there are many CE students in lai?ge cities. The rank order of urbanicity for 
those receiving Title I an£ "Other CE dnly" combined, among the poor, is 46 
percent for rural areas, 4fe percent for cities over 200,000, 35 percent fox 
cities under 50,000, 34 percent for suburbs, and 28 percent for cities from 
50,000 to 200,000. The orcjler is the same for the non-poor, with 26 percent 
for rural, 24 percent for cfxties over 200,000, 19 percent for cities under 
50,000, 17 percent for suburbs, and 15 percent for cities from 50,000 to 
200,000. In terms of absolute numbers, the number of students from rural areas 
receiving CE outnumbers these for any other category. The percentages for the 
suburbs tend to be lower^lSjan for rarge cities and rural areas, but there is 
still a sizable, number of students (receiving CE in 'the suburbs. While there 
is a trend for.CE to be most prevalent in the large cities and rural areas, 
it is significant that, there are sizable numbers of CE students throughout 
th~ country, irrespective of the population density of the area in which thdy 
live. — - , 

while some say that the ghetto, others think, of ft in terms of a pro- 

gram f02\"the poor rural south. * Again this is not in accord with the facts. 
Table III-5 shows the percentage of students receiving services by ^tegiorvof 
the country. ^Jt Title i services and "Other CE only" are combined, aunoiig, the 
poor, 51 percent of the students in the West, 42 percent in the Mid-Atlantic, 
41 percent in the South, 38 percent in the Northeast, and 30 percent in the 
Midwest receive CE* The picture among the non-poor is different than it is 
for -the poor. For the non-poor, the _Northeast with 31 percent and the West 
with 26 percent are considerably higher than the other areas, which are quite 
close together, with the MidHttlahtic and the Midwest both having 17 percent, 
and the South having 15 percent. To understand this, it is worthwhile to look 
at the Title I and the "Other CE only 1 ' figures separately. Among the poor it 
is noticeable that the percentage for Title I in the South is uiuch higher than 
elsewhere in the nation. Associated with "this is the fact that the South is 
lowest 'n "Other CE only," reflecting* the fact that there are few local or 
state CE programs in the South* In fact the percentage of students receiving 
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Table XII-4 

Percentage of Students Receiving Various CE Services 
by Family Economic Status and Orbanism 



/ 



Economic and 
Prbanism Statu* - 

T * 


Title I or 
Title I and 
Other CE 


- 

Other CE. 
Only 


No CE 
at CE 
School 


HQ CE 
at Hon* 
CE School 


Nuabex 

o£ 

sbuOBnws 


Boor and 


» 






r 






City over 200,000 


33% 


-12% 


50% , 




5% 


1,334,000 


' Suburb*. 


18 


16 


61 

9 




5 


238,000 


City from 50,000 


15 


13 






20 


443,000 


City under 50,000 


27 


8 


57 . 




8 , 


1,133,000 


Rural 


, 36 


10 ^ 


49 


i 


• -? 


1,033,000. 


lion-Poor and 














City over 200,000 


.16 


8 


65 




11 


1,757,000 


Suburbs 


5 


12 


68 

i 




15 


2,421,000 


City from 50,000 
to 200,000 


5 


10 


50 




35 


2,105,000 


City under 50,000 


12 


7 


66 




15 


4,969,000 


Rural 


13 


13 


64 




10 


4,573,000 


Total 


2,941,000 


2,,00C,0Gu 


12,264,000 


2, 


801,000 


20,006,000 



Title X services, both for the poor and the non-poor is fairly similar through* 
out the country, except for the South. The big differences are in the "Other 
CE only" category where the South and Midwest have few progress, in contrast to 
the West and Northeast, which have the most. The relatively larger number of 
students receiving Title I services in the South is probably a reflection of 
the relatively lower economic status of the South and the influences of the 
Title vX allocation formula that allocates larger sums to states having more 
poor families. 
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Table III-5 



Percentage of Students Receiving' Various CE ^Services 
by Family Economic stilus andyGeograpbic Region 

_n - ' , 

l K * ■ ■ a 




CEr Selection Status 



Economic and 
Regional Status 



Title I* or 
Title I and 
1 Other GE 



Y 

ier\CE 



Other\ CE 
Only 



Mo CE 
at CE*- 
School 



No CE at 
Non-CE 
School 



Number of 
Students 



Poor arid L. 






\ 






Northeast 


24% 


14% 


\ 59% 


3% 


853,000 


- Mid-Atlantic 
* 


24 


18 


M 49 




330,000 


South 


38 


3 


50 


9* 


1,443,000 


Midwest 


24 


6 


63- ' 


6 


832 ;ooo 




27 








West 


„24 




. % ' w * 


723,000 












i 


Non-Poor and 












Northeast 

> 


10 

1 


4 21 




X * 13 . 


.2,994,000 


Mid-Atlantic 


9 , 


8 


75 


8 


2,657,000 


South 


11 ' 


4 , 


65 


20 


3,988,000 


tyidwest 


11 


6 




11 . 


4,478,000 


.lUmt 


11 ' 


15 


46 


28 


2,358,000 



Total 



2,941,000 



,000,000 12,264,000 2,801,000 20,006,000 



Report #2 examines other student characteristics relative to selection for CE 
services, but there are fewer interesting trends. There are slightly more 
male than female CE students, about a 4-percentage-point difference. Also, 
there tends to be slightly more CE offered to # students in the second, third 
and lourth grades than to those in the first grade or in the fifth and espe- 
cially the sixth grade. / 
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In suanary, poor students are more frequently selected to receive CE services 
than non-poor students, but because^ there are more non-poor than poor students, 
there are larger numbers of non-poor students than poor students receiving CE. 
Relatively, there are more Hispanic than black students, and more black stu- 

* dents than white students receiving CE, but in terms of absolute numbers, there 
axe ipr* white students than black students receiving CE, and more black stu- 

t dents than Hispanic students receiving CE. *gsin, in term or percentages, 
there are more CE students in rural areas and large cities than there are in 
mediw- and small-sized ciMes. The percentage of students receiving Title I 
services is qui;,* uniform over the various regions of the country, except for 
thA South, where there is a much higher percentage receiving Title I. But 
*:*n "Other CE only* is included a different picture emerges. The. South has 
a very low percentage of students in these other programs while the West and 
the Northeast have high percentages. It appears that other federal agencies, 
and the state and local governments, are funding sizable programs in the West 
and the Northeast, and to a lesser extent in the Mid-Atlantic area, while there 
are few programs in the Ilidwest a t even f fewer in the South. 

EDUCATIONAL ACHIEVEMENT AND SELECTION FOR CE 

Schools are selected for receipt of Title I resources based on the economic; 
status of the populations they serve* But once a school receives Title I re- 
sources the students are selected to receive Title I services on the basis of 
educational need. Title I regulations give guidelines as to which students 
should be selected. Generally, it is expected that the most educationally 
needy students will be selected first and that the students selected will be 
in the oot torn half of the achievement distribution. But within these broad 
guidelines the tctua^ selection of students is left up to the local district 
nd school authorities. Thun, from locale to locale, one finds considerable 
variation in the achievement level of students selected. • 

In the Participation Study all of the students took the Comprehensive Tests of 
Basic Skills in reading and math in the fall and again in the spring. B*tse< 
on the scores obtained frcu the savaral administrations, scales were developed 
which allowed us to convert raw scores into percentiles and into vertical 



/ 

scale scores , and to determine the score corresponding to the median for each 
grade. This median score was necessar" because, for the purpose of this study, 
achievement was defined by Congress as "Educationally disadvantaged children 
refers to children who are achieving one or more years behind the achievement 
expected at the* appropriate grade level for such children." Table III-6 shows 
the percentages and numbers of students in various CE categories in terms of 
grade equivalents as measured by the CTBS. * 



Table III-6 

/ 

Percentage and Number of Students Receiving Various 
CE Services by Educational Achievement Status 









CE Selection Status 








Title I or; 




No CE 


No CE at 






Educational 


Title I ar 




Other CE 


at CE 


Non-CE 






Achievement 


Other CE 


I 


Only 


School 


School 


Total 




Low Achievers* 


31% 




.15% 


42% 


12% 


-100% 




Regular Achievers 


10 




9 


66 


15 


100*, 






1 




/ 

Number of Students 






Low Achievers , 


l,188,00Cl\ 


577,000 


1,576,000 


456,000 


3,797, 


000 


Regular Achievers 


1,3C7,000\ 


1,068,000 


8,245,000 


1,948,000 


12,568, 


000 




2 , 495 , 000— V— 1 , 645 , 000 
A 


9,821,000 


2,404,000 


16, 365, 


000* 



/ *Ctaitting the first grade, since it ^oes not fit into the definition of having 
students "one $rade level below." \ 
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It will be seen that in terms of percentages there are many more students 

selected for CE services who are performing at least one grade level below 

' \ 
their assigned grade level than there are among higher-achieving students. 

1 , \ 
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Forty-six percent of the low-achieving students* are selected for some CE 
while only 19 percent of the regular ^students are selected. At the same time, 
54 percent of the low-achieving students are not receiving CE services. In 
terms of absolute numbers, about two million low-achieving students are not 
receiving extra services, in contrast to about 1,750,000 who are receiving 
CE services. It should also be noted that about 2,400,000 high- achieving stu- 
dents are receiving CE services* It iff clear that many students are receiving 
CE who are less educationally needy than the many needy students who are not 
receiving CE. lie will see some of the reasons for this later when we consider 
the joint relations between economic status, which determines which schools 
receive CE funds (such as Title I) and educational status, which determines 
those students within a school who are selected. 

There are a number of psychometric pro! its in defining achievement in terms 
of grade equivalents. For one thing, the first-grade students cannot be de- 
fined in terms of being one year below grade level. Also, the amount of 
variance or spread in student scores changes from grade to grade. For example, 
in the sixth grade there may be students three or more years below grade level, 
but in the second, grade they can only be one year below. The result is that 
different percentages of students are included in one year belot- grade level 
as grade level changes. There are also other statistical problems. The in- 
terested reader is referred to Tallmadge, G. K. , and Hood, C. T. (18), for a 
detailed discussion of the problems with using the grade equivalent metric. 
Because of these problems, we converted < zh student's raw test score to a 
percentile equivalent and divide* the distributions into quwtiles. Table 
III-7 shows the results. 



*"Low" and "Regular Achievers * are defined as achieving below or above cue 
year below grade level/ This definition was contained in the law authorizing 
the Participation Study. Selection of students for Title I is based on several 
criteria. The title I regulations suggest that all children below the median 
be considered. * 
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Table III-7 

Percentage and Number of Students Receiving Various 
CE Services by Achievement Quartiles* 







CE 


Selection Status 




Achievement 

Status 

* 


Title I or 
Titie I and 
Other CE 


Other CE 
Only 


No CE 
at CE 
School 


No CE at 
Non-CE 
School 


1 \J LCll 


Bottom Quartile 


32% 


14% 


42% 


11% 


99% 


2nd Quartile 


19 


11 


i 

5$ 


12 


100% 


3rd Quartile 


7 


8 


70 


15 


100% 


Top Quartile 


2 


6 T 


75 


17 


100% 






Number of Students 




Bottom Quart;"* e 


1,579,000 


718 . 000 


2,110,000 


56C 000 


4,967,000 


2nd Quartile 


910,000 


543,000 


2,809,000 


605,000 


4,867,000 


3rd Quartile 


368,000 


411,000 


3,600,000 


762,000 


5,141,000 


Top Quartile 


89,000 


301,000 


3,772,000 


869,000 


5,031,000 




2,946,000 


1,973,000 


12,291,000 


2,796,000 


20,006,000 



•Derived from Table V-5, Report #2. 



There is a clear tendency for there to be proportionately more CE students as 
achievement scores decrease. This is true of both Title I and "Other CE only." 
It should be noted that the percentage of students in the bottom quartile is 
very similar to the number in the previous table who are one year below grade 
level. (The absolute numbers between the two tables cannot be compared be- 

6 

cause Table III-6 does not include first graders.) It appears that the selec- 
tion of students corresponds reasonably well with the educational need of the 
students, but a fairly large number of students do not seem to need CE but are 
receiving it. About 450,000 Title I students, and 700,000 "Other CE only" 
students, are above the median in achievement and are receiving CE services. 
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Some of these students may be misclassif ied due to the unrealiability of the 
CTBS, but a similar number below the median should be classified above it, 
so the figures average out. Also, some of the CE selectees are in schools 
which are 100 percent CE f which is allowed by Title I under certain conditions. 

While significant numbers of educationally non-needy students are certainly 
receiving CE, the more significant problem is the 2,700,000 students who are 
in the lowest quartile academically and who are not receiving special services; 
or, if one believes that all students below the average should receive CE, one 
should be concerned with the 6,100 000 students who are in the bottom half in 
term of achievement and are not receiving CE. Clearly, if all students who 
are above the median and are receiving CE were to be replaced by students 
frelow the median there would still be sizable numbers of students below the 
median who would not receive CE services. The only way to correct this situa- 
tion is to dilute the services being given so more students could receive a 
little, or to increase the funds so that more students could be given perc.ce* 
at th- >ame intensity level as is currently practiced. 

_ t 

EDUCATIONAL ACHIEVEMENT STATUS AND THE CHARACTERISTICS OF STUDENTS SELECTED 
FOR CE 

We have already examined the relationship between poverty status and the charac- 
teristics of students selected for CE. Mhile at the student level the correla- 
tion between poverty and educational achievement is not high, it is considerably 
higher when school averages* are correlated. Because of the higher correlation 
at r j group level, we would expect the relationship between educational^ achieve' 
tent status and the characteristics of students selected for CE to be fairly 
similar to that for these same characteristics as when related to poverty. The 
achievement levels of students by race/ethnicity who are selected for CE were 
examined. The c result show the effects are the same as fbund for poverty, al- 
though the trends do not seem to be quite as pronounced as when classified by 
educational acnievements """^ 

Again there are some interesting trends in the relationship between achieve- 
ment status and urbanicity with respect to selection for CE- As with poverty, 
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students from j.arge cities and from rural areas are most frequently selected 
for CE services.' This is true for students who are either low or high achievers 

On exam* -ling the relationships among geographic regions of the country, educa- 
tional achievement and selection for CE, we again find that the Northeast and 
the west have the highest percentages of students selected for CE services, 
while the South has the lowest. Again, the South is low because it has so few 
students served by other federal, state or local programs. Almost all of the 

students served in the South are served by Title I. 

j 

THE JOINT EFFECT- OF ECONOMIC STATUS AND EDUCATIONAL ACHIEVEMENT 

It seems probable that the supporters of the Title L program assumed that there 
was an almost one-to-one relationship between poverty status and educational 
achievement. It is widely believed that schools in poor areas have students 
who score poorly on achievement tests. But what is "the actual relationship? 
In the Participation Study we were able to reiate family income* with achieve- 
ment test scores. The overall correlation between economic level and achieve- 
ment scores at the student level was .29, and varied, grade by grade, from .20 
in the first-grade to .32 in the third and fourth grades. Relationships ofS . 
this magnitude are generally considered . sma 1 1-t o-modeira te and iaply that if 
one knows a student's economic status one can predict the student's achieve- 
»ent level with only vc modest success. It is this low relationship which 
accounts for the finding, reported earlier, that many non-poor students per- 
form poorly and are receiving CE. On the other' hand when groups of students 
are combined, say by taking the average achievement level for a school, then 
the combined average scores , relate more highly. In fact, when the average fam- 
ily economic level for a school is correlated with the av .xage student achieve- 
ment level for students in a school, the correlation is ,67. This means that if 
one' knowr the average poverty level of a school one will be able to predict the 
average level of the performance of students in the school much more accurately 
than'one can predict the achievement lev^l of any given student on the basis of 
the student's family economic level'. 
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When schools are allocated CE funds based on poverty level, the students will 
tend to need supplemental services if the school is within a poverty area, but 
there nay also be many individual students who do not need CE services; and 
conversely, if schools are not given CE funds because of. thcdr relatively high 
economic levels, these schools will still' probably contain many students who 
need CE services as indicated by their low achievements. Table IIX-8 shows the 
Man achievement percentiles for students with various family incoaies. This 
table illustrates the marxed relationship between family income and achievement 
when data are grouped, but such grouped data mask the wide variation. within any 
group. The large standard deviations emphasize this fact. 



^able I I 1-8 

Student's Family Income and Achievement Level 



Family income 


Hun Achievement 
Percentiles* 


Standard ' 
Deviation 


N 


Below $5000 


; 34 


25 


1524 


5,000 co 7,000 


37 




. 1005 

r 4 


7,001 to 9,000 


41 


27 


1109 


9,001 to 11,000 


45 


28 


1188 


11,001 to 13,000 


48 


28 


1234 


13,001 to 15,000 


52 


,8 


1259 


15,001 to 17,000 


53 


19 


1248 


17,001 to 19,000 


57 


28 


1146 


19,001 to 21,000 


58 


• 28 


997 


21,001 and above 


62 


27 


3087 



♦There are technical statistical reasons why it is usually inappropriate to 
average percentiles; however, when used to show a trend, as is done here, 
the practice is less objectionable. 



Economic status and achievement level are related tb a number of other vari- m 
ables. As in the previous sections, we will examine the joint relationships 
among poverty, achievement level, and race, urbanicity, and geographic region, 
and we will also consider the relationship of CE selection to the child's sex ' 
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LXid mother's education. Table III-9 shows the relationships between poverty, 
achievement and* race. The average achievement percentile for whites is 56, 
while that for blacks is. 32 and for Hispanics 31. "Others," who are largely 
Orientals, 'have an average percentile bf 51. When examined in terms of povercy, 
the poor whites have aft average score of 41, while that for the non-poor is 57. 
In con5»rison the score for both the poor blacks and poor Hispanics is 27* while 
that for the non-poor blacks is 36 and for the non-poor Hispanics it is 34. It 
should i?e noted that the score for the non-poor blacks and Hispanics is below 
that of the poor whites. No doubt the economic level of the non-poor blacks 
and Hispanics is lower than that of the non-po o r whi tes, but it J s above the 
economic level of the poor whites. Children from black and Hispanic non-poor 
famines need C£ considerably more than children from not only the non-poor white 
families, but also more than those from many poor white families. The "Other M 
minorities are more similar to the whites than they are to the blacks and Hispanics 

s 

Poverty level and the parent's formal education are linked, and children's 
achievement levels are also related to both economic status and the parent's 
education* Tabid 111-10 shows this # relationship. It is seen that the per- 
centile achievement level of <^iildren whose mothers had eighth grad^ educations 
or less is 32 and that the level of achievement progresses regularly to 70 for 
students whose mothers are college graduates. The achievement of children from 
poverty hones is considerably below that of their peers who are from non«-poor 
homes but whose mothers had the same amount of formal education. The jump in 
scores between the children of mothers with an eighth grade education or less 
* and those with a high school education is 21 percentile points, and that be- 
tween high-sOiool-educated mothers and college graduates is 17. The jump 
between children whose mothers had similar educations, but whose family income 
places them in the poor or non-poor category, is about 12. Thus,* a mothers 
education seems to have a larger effect on her children* s achievement than 
does her economic status. 

Table III-ll shews the relationship between economic status, academic achieve- 
ment, z-A urbanicity. The table shows that, in general, the achievement level 
is near the 50th percentile except for the suburbs, wherp it is 59, and for 
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Table III-9 

Student's Family Income , Achievement Level and Race 



Race/Ethnic 
Group 


Mean Achievement Percentile 
Poor " Non-Poor Total 


Poor 


N 

Non-Poor 


Total 


Whit* 


41 


57 


56 


1,192,000 


10,598,000 


11,178,000 


Black 


27 


36 


32 


949,000 


1,100,000 


2,049,000 


Hispanic 


27 


34 


31 


343,000 


590,000 


933,000 


other 


33 


56 


51 


70,000 


260,000 


330. t ooo 



■ 

Table 111-10 

* 

Student 1 s Family Income, Achievement Level and Mother's Education 



Mother's 

Education 


Mean Achievement Percentile 
Poor Non-Poor Total 


Poor 


N 

Non-Poor 


Total 


Grade 8 or Less 


28 


35 


32 


793, oqo 


917,000 


1,710,000 


Grade 9*11 


31 


44 


40 


892,000 


2, #9, 000 


. 3,161,000 


Grade V> 


38 


. ,55 


53 


635,000 


5,518,000 


6,153,000 


Some College 


48 


62 


61 


185,000 


2,382,000 


2,567,000 


College Graduate 


60 




70 


50,000 


1,409,000 


1,459,000 


* 

• 








77 


* 

4 " 
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Table III-ll 

Student's Family Income, Achievement and Urbanicity 





Mean Achievement Percentile 




N 




Urbanicity 


Poor 


Non-Poor 


Total 


Poor 


Non-Poor 


Total 


City over 
200,000 


27 


44 


t 

38 f 


api,ooo 


1 

* 

1,409,000 


^,211; 000 
2,023,000 


Suburbs 


35 




59 

* 


144,000 


' 1,879,000 


City froia 50,000 
to 200,000 


33 


55 


- 53 


254,000 


1,675,000 


a 

1,929,000 


City Under 
50,000^ 


37^ 


55 


• 

52 


675,000 


3,924,000 


1 

4,599,000 


Rural 


37 


55 


52 


668,000 


3,577,000 


4,245,000 



the large cities, where it is 38. This very low score for the large cities 
*eans that they should have many students enrolled in CE programs, and indeed 
this is the case. But we have previously seen that r/ral areas also have many 
students^in CE programs, and yet they have achievement levels slightly above 
the nat^oxial meitf? This probably reflects the relative poverty of rural areas, 
whereby they relatively more Title I funds than would be indicated by the 
achievement levels of rural students* Within urban areas of the* same size, 
there is a marked difference in the achievement levels of students from poor * 
and non-poor families, with the children from poor families scoring about 18 
percentile points below those from non-poor families. 

The analyses done over regions of the country are shown in Table 111-12 and 
show soma expected and unexpected results. As teflected by the overall figures, 
the rank 4 order of the regions, in terms of achievement, is Midwest, Northeast, 
Mid-Atlantic, and South and Rest tied at the bottom. The rank orders, when 
examined separately for the poor and the pon-poor, are essentially the same. 
As expected, the Midwest and Northeast are at the top of the rankings, and the 
South is at the bottom. But what is unexpected* is that the West should be at 
the bottom with the South. When the West is examined in mo^e detail it turns 
out that Pacific Northwest children l^ve scores which are, slightly higher than 
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those for the Midwest, but the scores for the Pacific Southwest are lower than 
for any other sub-region of the country. This id presumably due to the fact 
that there are many Hispanics in the Pacific Southwest* and, as we have pre- 
viously seen, their scores are among the lowest of any group. This finding 
should be interpreted cautiously because of possible sampling errors for sub- 
regions, and because of problems that many Hispanic, children may have had with 
an achievement test where the test items were in English (but it should be 
noted that the instruction in the schools was also in English), nevertheless , 
there are large regional differences and the need for CE is reflected in these 
regional differences in achievement. 

i 

Tabl^III-12 

Student's Family Income, Achievement and Geographic Region' 



Geographic 
Region 


Mean Achicvaaent 

Poor Son-Poor 


Parcantila 

To^al Poor 


M 

Non-Poor 


Total 


Northeast 


36 


58 


54 


474,000 


2,414,000 


2,888,000 


^id-Atlantic 

i 


34 


55 


52 


195,000 


1,618,000 


1,613,000 


South 


31 


49 


45 


4*413,000 


3,117,000 


4,130,000 


Midw«8t 


40 


60 


58 


497,000 


3,533,000 


4,030,000 


Hut' 


30 


48 


45 


407,000 


1,939,000 


2,346,000 



Finally,. it should be noted that there are sex differences associated with CE 
selection. It has long been known that at the elementary leyel girls score 
higher on achievement tests than do boys* Table 111*13 again demonstrates 
this fact. It will be seen that for both poor and non-poor children the mean 
test score for girls is somewhat higher than for boys. There are thus tt^re 
boys receivirg CE than there are girls. This should not be attributed to^vex. 
discrimination, but rather to the fact that, in terms of a uniform standard j 
of achievement, boys need CE acre than girls do. j 

64 79 J* 
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Table 111-13 



Student's Family Income, Achievement and Sex 





Mean Achievement Percentile 


j 


N 




Sex 


Poor' 


Non^Poor 


Total 


Poor 


Non-Poor 


Total 


Boys 


31 


52 


.49 


1,263,00Q 


6,409,000 


7,672,000 


Girls 




57 


54 


1,253,000 


6,098,000 


7,351,000 



It the beginning of this chapter we mentioned Congress 1 requirement tha£^^ 

study be undertaken to determine the nuntoer of students receiving TWle I 

services as a function of the poverty level of the families from which the stu- 

\ # 
deiits came and also as a funct. 4 n of the levels of achievement of the children. 

We now examine the joint effect of > poverty and achievement on selection 

for services.^ fable 111-14 shows the percentage of students selected for 

CE as a function of the definition in the law, namely^poverty, defined in 

terms of th* Orshansky Index, and achievement defined in terms of low, or 

regular achievement*. One can. determine from the takle that 74 percent of the 

students do not receive any CE, 16 percent receive Title I, and 10 7 percent^ 



receive* other CE. Of the students who are both poor and low acMevers, 47 
percent \do not receive any CE while 53 percent do. Of those who are non-poor 
but low achievers, 58 percent do not receive CE while 42 percent do. Similarly, 
among^tlpise who are poor but regular achievers, 70 percent do not receive CE, 
while amohg the non-poor and regular achievers , 83 percent do not receive CE— 

* 9 r * 

although 17 percent do. Ideally there would be no students in the low-achieving 
t grot*? who were not receiving qs, ana thejre would be few regular-achieving stu- 
dents who are receiving it. But when one considers the difficulty of correctly 
cldjsifying children (often based^ on subjective judgments and less than per-' 
fectly reliable tests) the^unbers showji seen to represent a reasonable per- 
formance a the part of the schools in selecting CE^students. Given an effec- 
tive selection- system, the most straightforward way of supplying CE services "* 
to the large number of educationally needy students who do not receive CE is / 
to increase the funds available. A - -* 
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Table III -14 _ 

i • 

Student 1 s Family Income f Achievement and CE Selection 

(Graqas 2-6) 



*\ - 1 


TitJ^f/Title I 
and^bther CE 


i * Other CE 










Ho a ^ 


' -J* V 

Poor - Low Achiever i 




14% 


* 47% 


Non-Poor - Low Achiever 




16 


58 


Poojj - Regular Achiever 


22 


8 . 


70 


Hon* Poor - Regular Achiever 


Q 
O 


Q 

Number Selected 


83 


Poor - Low Achiever 


573,000 


196,000 


671,000 


non-Poor - Low Achiever 


606,000 


376,000 


1,358,000 


Poor - Regular f chiever 


442,000 


164,000 


1,391,000 


Non-Poor - Regular Achiever 


851,000 


900,000 


8,821,000 


Total 


2,472,000 


1,636,000 


12,241,000 



thji 



He have previously noted thffc the Office of Education regulationa_regarding 
how students should be selected for CE indicate that they should be selected 
from the bottcw half of the achievement distribution, table IXI-15 shorn how 
CE selection is related to economic status in terms of poverty level, as de- 
fined by the Orshansky index^nd achievement, defined as falling above or 
below the midpoint of the achievement distribution. Under this relaxed defini- 
tion many more student* are eligible for selection because they fall in the , ^ 
bottom half of the achievement distribution. This table shows that 53 percent 
of the students who are poor and in the bottom half in achievement 4& not re** 
ceivm OS, while 67 percent of the non-poor and low achievers do not receive CE. 
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Table 111-15 



Student's Family Income, Achievement an£ CE Selection 
/ with Different Selection Criteria* 



Poor and bottom half in 
achievement 

Non-Poor Vhd bottom half 
in achievement 

Poor and top half in 
achievement 

Npn-Poor and top half in 
achievement: 



Poor and bottom half in 
achievement 

Non-Poor and bottom half 
in achievement 

Poor and top half in 
achievement 

Non-Poor and top half 
in achievement 

Total** 



Title I/Title I 
and Other CE 



Other CE 
Only 



No CE 



Percent Selected 



37% 



20 



916,000 

1,111,000 

82,000 

278,000 
2, 387,000 



10% 



13 



53% 



67 



.84 



G9 



Number Selected 



lected 



244,000 , 1,292,060 



736,000 

65,000 

540,000 
1,585,000 



3,679,000 

• », 

' 752, Wo 

6,605,000 
12,328,000 



•Table II 1-14 shows the percent selected for CE in terms of the criteria 
selected by Congress. for the Participation Study. This table retains the ** 
saae definition of poverty but divides the students in half on the achieve- 
nent criterion. ' ' 

"These totals differ from those -in Table 111-14 because of rounding errors. 
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On the othv.- hand 16 percent of the poor and in the upper half in achievement 
do raceive CE and 11 percent of the no.*-poor and high-achieving students re- 
ceive CE. In Report #2, other definitions of eligibility are considered. The 
nusfcer of 'students who do or do not receive CE services varies considerably 
as various definitions are adopted. Thus, a judgment about how well stud-Mvs 
are selected and how many are served by CE prograsis depends on how poverty and 
achievement are defined. 

Mr 

THE EFFECT OF DIFFERENT MEASURES OF ACHIEVEMENT 

The analysis of the number of children receiving CE as a function of their 
achievement level Juts been based on combined reading and math measures. That 
is to say that a student's CE stasis was defined in terms of whether or not 
the student was receiving reading and/or math CE services, w:*th the achieve- 
■eat level being determined L/ the score ^ on a combined reading and math a' hieve- 
ment test scale. While the law requiring the Participation Study spoke of 
Title I as an overall program rather than in terms of reading services or math 
"services separately, it seemed desirable to sea if the classification of stu- 
dent- would be Gauged if the classification were based on a reading test, a 
math test, or the two combined* It has also been argued that the rest ts 
tight have been dif ierent if the analysis had been done separately if the 
studenws receiving reading CE had been classified on a reading test and the 
students receiving math CE had been classified on the math test results, 
rather than on results from combining the reading and math tests. 

The reason the original analyses were done on the basis of the combined scores 
was the belief that the separate analyses would give essentially the same re- 
sults as those based on combined test scores and that the law di not make , - 
any distinction. This belief was based on the fact that there was a high cor- 
relation between tbt combined score and either the math or the reading test 
separately. Table 1-16 of Report #9 shorn that these correlations range from 
a low of .82 co a high of %96. However, interest continued as to the nature 
of the resu lts if_the ana lyses hau been c^ne usin g se parate test scores. We 
therefore made a special analysis for this report. Table IXI-16 shows the 
percentage of students receiving various CE Services wherTin*«Tfled~TS~"terms 
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Table 111-16. Percentage oi Students Receiving Reading and/or Math CE Services 
by Achievement Level Based on Reading, Math, or Combined Achievement Tests 













;CE Selection Status 














Achievement 
Level 


Title I or 
Title I and 
Other CE 


Other. CE Only 


a 


No CE at 
CE School 




No CE at 
Non-CE School 


Total 


< 


Reading Math 
% % 

! 


Both 
% 


Reading 
% 


Math 
% 


Both 
% 


Reading 
% 


Math 
% 


Both 
% 


Reading 
% 


Math 
% 


Both 
% 




/ 

Low Achievers 


3 1 


28 


31 


16 


17 


15 


42 




45 


42 


10 


11 


12 


99% 
101% 
100% 


Regular Achievers 


9 


12 


10 


9 - 


10 


9 


63 < 




67 


66 


11 


12 


15 


98% 
101% 
100% 



ft 
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of a reading test, a math test, and both tests combined. Here the students 
are classified as CE students if they are receiving reading CE only, math CE 
only, or both. Table 111-17 shows similar results except that the students 
are classified in terms of achievement test quartiles rather than in terms of 
grade equivalents. It will e seen that the results are very similar irres- 
pective of whether the classification is done by the use of combined tests or 
separate! by the reading or math tests. Thus, we conclude that the results 
reported in Reports #* and #3 are invariant to the particular achievement 
classification scheme used. 

As indicated above, it was also suggested that the classification of -students/ 
should h,ive been done separately for reading or math CE services and the appro- 
priate reading or math tests should have been used to make the classifications. 
Again special analyses were done for this report and the results are shown in 
Tables 111-18 and 111-19. The tables show that the percentages of students 
classified in the various achievement levels by type of CE service are almost * 
identical whether classified in terms 6f the reading test for reading Ce or 
the math test for math CE or in* terms of both tests combined. Of course the 
• tables also show that there are only about one half as many students classified 
as receiving math CE as there are receiving reading CE. The results reported 
here are almost identical to those previously r^oorted in Table 2-2 -of Report #3 
of the Participation Study* * 

Our overall conclusion is that it makes little difference whether the achieve- 
^menT scores used to classify students on achievement are reading scores alone, 
math scores alone, or both combined. The proportion of students designated 
as receiving various CE services in terms of levels of achievement is essen- 
tially the same irrespective of the particular achievement measure used. 

HOW ARE STUDENTS SELECTED ^FOR CE? 

The selection of schools to receive CE resources and the selection of students 
for CE services is a comple. process and varies considerably from distr. 4 *t to 
district and from school to school. SES Report #5 explores this problem in 
some detail. It concludes that in selecting schools for CE resources, dis- % 
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Table 111-17. Percentage of Students Receiving Reading and/or Math, CE Services 
by Quartiles on Reading, Math, or Combined Achievement Tests 













CE Selection Status 










* 

Achievement 


Title 


I or 
























Title 


I and 










No 


CE at 




NO 


CE at 




Total 


Level 


Other CE 




Other CE Only 


a CE 


School 




Non-CE School 

* 




Reading Math 


Both 


Reading * 


Math 


Both 


Reading 


Matb , Both 


Reading 


Math 


Both 






% 




• 


% 


% 


% 


% 


% 


% 


% 


% 


% 




Bottom Qua r tile 


* 

31 


28 


32 


17 


16 

* 


14 


42 


46 


42 • 


10 

* 


10 


11 


100% 
100% 
99% 


2nd Quartile , 


19 


20 


19 " 


13 


13 


11" 


57 


57 


58 


ft 


11 


12 


99% 
- 1Q1% 
100% 


Ird Quartile 


7 


10 


7 


9 


* 9 


8 


73 


70 


70 


11 


12 


15 


100% 
101%« 
100% 


Top Quartile 


3 


3 


2 


6 


8 


6 


79 


79 


75 


12 


11 


17 


100% 
101% 
100% 
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« Table ni-18. Percentage of Students Receiving Reading (or Hath) CE Services 
by Achievement on Reading (or Math) Achievement Tests or Both Tests Combined 



s 


Heading CE Selection Status 




% 

Achievement % 
Status } 


Title I or 
Title I and 
Other CE 


Other CE Only 


CE at 
a CE School 


H 

No CE at 
Non-CE School 


Total 




Reading Both 
% % 


Reading Both 
% % 


Reading Both ' 
> % % 


Reading Both 
% * % 




One Grade Level 
Below 


27 28 


17 18 


* 

46 44 


11. 10 


100% 


Above One Gjrade 
. Level Below 


8 7 


> 8 8 


72 73 


12 12 


L00% 





* 


Math CE Selection Status 




mm 




i 


Achievement 
Status 


Tide I, or 
Title I and 
Other CE 


Other CE Only 


j 

No CE at 
a CE School • 


No CE at a 
Non-CE School 


r * 
Total 




Math Both 
% % . 


Hath 
. % 


Both 
% 


Math - 
% 


Both 
% 

4-* 


Math 
% 


Both 
% 




One Grade Level 
Below 


15 18 


r 

* 13 


.*> 
14 


61 


58 


ii 


10 


100% 


Above One Grade 
Level Below 


5 4 


8 


7 




77 


12/ 

\ 




100% 




1 








> 






* 



r 



Table 111-19. Percentage of Students Receiving Reading (or hath) CE Services 
by Quartilefc on Reading (or Math) Achievement Tests or Both Ttests Contained 



Achievement 
Status 



Bottom Quartile 

2nd Quartile 
* 

3rd Quartile 
I 

Top Quartile 



Title I or 
Title I 
Other C 



Reading 



27 
17 
5 
<2 




Reading CE Selection Status 



23 
16 
6 

2 



Other CE Only 



Reading 
% 



Both 
% 



17 
12 
8 

5 



17 
13 
8 
5 



No CE at 
a CE School 



Reading 
% 



Both 
% 



46 
61 

' 75 
t 81 



45 
60 
75 
81 



No CE at a 
Non-CL School 



Total 



Reading 
% 



10 
10 
11 
12 



Both 
% 



10 
11 
11 
12 



100% 

ioq£ 

100% 
100% 



Achievement 
Status 



Math CE^ Selection status 



Title I or 
Title I and 
Other CE 



Math 
% 



Both 
% 



Other £E On^ 



Math 
% * 



Both 
% 



No CE at 
a CE School 



Math 
% 



Both 
•% 



No CE at a 
Non-CE School 



Math 
% 



Both 

% ' 



Total 



Bottom Quartile 
2nd Quartile 
3rd Quartile 
Top Quartile 



14 

9 
4 

2 



I 6 , 
9 
4 
1 



13 
10 
8 
7 



13 
10 
8 
6 



62 
69 
76 
81 



61 
70 
77 
81 



10 
11 
12 
11 



10 
11 

11 
12 



100% 
100% 
100% 
4 100% 




91 



tricts use a number of criteria and that "the motet frequently used criteria, 
either alone or in combination are: free or reduced-price lunch counts alone 
(22 percent), AFDC enrollment alone (is percent) and free or reduced-pricf 
lunch counts combined .with AFDC enrollment (14 -percent) . The remaining 49 
percent of the districts repotted using other combinations of criteria with 
no single combination being used by more than 6 percent of the districts 
Once a school receives CE resources it has the problem of how to determine 
which students actually are selected .to receive these resources. Again, we 
find a number of different methods being used. When school principals were 
asked to indicate how CE students were selected they indicated the methods 
shown in Table 111-20. 

It seems that test results and teichers 1 recommendations are the two most fre- 
quently used methods. Membership in targeted groups or parents' requests are 
used much less frequently. 

* 

Earlier we saw tjte relationship between poverty and achievement level and 
student selection for CE services. We concluded that generally the schools 
were doing a reasonable job in selecting the educationally needy students for 
receipt of CE services.- Note that we resort to statements such as "generally" 
to describe the success in selecting CE students. It would be desirable to 
have a numerical index to describe the relationship between need and selection-* 
a Targeting Index. If there were such an index it would allow comparisons of t 
actual . performances against sons numerical standard. It would make it .possible 
to compare the success of selection practice between schools, districts, or 
other categories of interest* In SES Report #13 a study is* re port ed tha t in- 
vest igat as the appropriateness of ^ -number of proposed targeting indexes. 
Twenty-f ive different indexes were examined based on dif ferqpt assumptions 
aboutLwhat «uch an index should measure . Here we will examine only two of the 
possible/indexes. The intereste<k*ceader will want to turn to^ the .full report. 

All of the indexes are based on the idea that students should be selected for 
CE based on educational .need. In exploring thf indexes, the levels of achieve- 
ment on the CTBS are ta ken as in dica tors of edu cational feed. The .first index _ 
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Table 111-20 



Criteria Used by I Schools for Selection of CE 

Participants, and Selection Rates for •Needy' and 'Non-Needy' Students* 



School 
♦Selection 
Criteria 



Percentage 
of 'Needy 1 
* Student* 
Selected 



Percentage of 
'Non-Needy 1 

Students. 

Selected 



i 



Test results alone f 

Test results and teacher recommendation 

Some combination of test results, teacher 
recommendation, volunteer, and/or 
parent request 

Teacher recommendation alone or combined 
With parent request and/or volunteer 



Membership in one or. more target groups 
only, or in combination with test 'results 

Target groups , test results, and teacher 
recommendation ^ 

Some combination of target groups, test. 

results , teacher recommendation, volunteer, 
and parent request 



All Students in the sch< 
Total 



iiol 



participate 



#♦ 



51 
49 

47 

49 

59 

43 

40 

(29) 
48 



7 
'4 



10 



or 

5. 



•'Needy' and 'Non-Needy' students are defined in terms of teacher's judgment 
of student's need for CE services,; * ? — 



**3ome principals reported that all students in their school participate in 
CE programs* However, the records of the Compensatory Education Roster 
(CER) do not indicate that all students in these schools* are selected for 
Title I services'. * 



! • 9 

kERJC 



/75 



93 



r 



uses the simple idea th-»t the index shoujld be based on the proportion of tu- 
dents selected for CE who fall below some cut-off point in achievement level. 
Thus, a school with all of its CE students below, say, the 50th pjszpentile, and 
none of them above it, is presumably doing a better job of selection than a . 
school where only half of the CE students are below the 50th percentile and 
half of them are above that level. Table 111-21 show, the actual distribution 
dt ichoola in our sample when the cut-off point is in the 50th percentile. It 
also shows the percentage distribution for the 35th percentile. The 50th per- 
centile is based on the idea that Title I regulations suggest that Title I 
students should be selected from those in the lower half of the academic 
achievement distribution. The 35th percentile was chosen because when teachers 
are aske£_ which students tfiey J^iink' are in need ofr CE services they tend to 
select' students who fall below the 35th percentile. The table should be read 
as follows:- for the 50 percentile cut-off \t shows that if a school had 1C0 



students receiving QE reading services then \there were 2 percent of the schools 
where 60 of the students were below the 50th percentile and 40 students were 



above the 50th percentile. Similarly there fe^re 11 percent of the schools 
where out of 100 students, 68 were below the 50th percentile and 32 were above 
it. At the mid-point in the distribution of schools, the typical school 
selected reading students in such a abnner that 88 percent of the students 
selected for CE were in the bottom half on achievement, and 12 percent in the 

7 

top half. Tor math the split is 84 percent in the bottom half and 16 percent 



in the top half. If the cut-off is changed to the 35th percentile then for 
the mediah school the iplit is 7& percent of th students below €he 35th ]*r*' 
centile in reading end 30 percent above it. For 'math the split for the median 
school is 6 2 perc ent below the 35th percentile and 38 percent Above it. 9 It 

will be noticed that schools do a better job of selecting educationally needy 

i \ m . 

students for reading CE than they do for math CE. It will also be seen that 

\ 

the apparent success of schools in selecting students to receive CE varies 
depending on €he cut-off level used; tfee schools give the appearance of d6ing 
a bet£*r job if the criterion is the 5Qth percentile. This fluctuation in the 
implications of the index is probably not serious if comparisons are made be- 
tween schools or districts, but the fluctuation ^s not de sirab le if an ab solute 



standard is needed. The most serious problem with this index is that- it con- 
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Table 111-21 



Percentage of Schools Having CE Selectees Who Scoi 
Above and Below the 50th and 35th Percentile • 



Percentage of Students Selected for CE : 
Below 50th Percentile Above 50th Percentile 



Reading 
% of- 20$ Schools 



Math " 
% of 161 Schools- 



36 
44 

52 
V 60 
68T 
76 
84 
92 
100 



Below 3r>th Percen 



64 
56 
48 
40 
32 
24 
16 
8 
0 



Above 65th Percentile 



0 
1 
2 
2 
11 
12 
24 
33 
15 



3 

\ 

4 

5 
11 
13 
24 
19 



12 




\ 


88 - 


9 / 


i 


20 

t 






80 




4 


28 






72 


2 


2 


36 


1 




64 


5 


4 


44 




f 


56 


6 


; 7 


52 






48 


12 


.8 


60, 






40 


13 


' I 6 


68 






32 




- -^18 


84 






24 

16. ~, 


. '21, 

i / 

17i ' 




92 
100 






8 

* 0 


* 6 • 

y • I- ' 


: / 6 

9 



/ 
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siders only the characteristics of the students who \re selected for CE and 
does not consider the characteristics of the students who are not selected. 
A school with almost all of its students needing CE would look very good on v 
the index irrespective of who they selected, since alatost all of the>s^udents 
selected wc id be below the cut-off point and there would be few students mis- 
selected. On the other hand a scjhool with a smaller propqrtioiT of needy stu- 
dents migfet try to do a very careful 'job of selection but would sake sons 
classification errors and would look relatively poor on the index . A good , 
index should consider the characteristics of both students who are selected % 
^nd thosfe ffho are not selected. 



txiowm 1 



An index), jp address that problem can be based- on the phi coefficient. A phi 
coefficient provides a measure of the degree of relationship 14 a four-celled 

table* One could make up a fable showing the number selected/ for CE; the 

, . - - ^ j i ^ * i t 

number not selected* and whtther^or not each student scored above cj below 

at score. Such a t*ble would lock 



defined achiev< 



like 



the one below. 



Achievement Scores 



Above 



y 



stitctid 



Not Selected 



0 


35 


1 55 


0 



Adjusted phi - 1.0 



The clomj the re' itionahip between i. lection for CE and scoring below the 
achievement criterion, < the higher the phi coefficient. Also, when the co- 
.efficient is corrected for the marginal splits, tz will vary from -1.00 to 
+1.00* thus giving an absolute standard. Tab 1 * 111-22 shows the adjusted phi 
coefficients for our schools for ^reading and math. It will be seen that a 
few schools do worse than would be expected by Jraridom selectibh , but most of . 
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Table 111-22 

Percentage of Schools By Adjusted Phi Coefficients, Showing Relationship 
Between CE Selection and Achievement Scores Dichotomized at the 35th Percentile 











/ 




Adjusted Phi 
Coefficient 


Reading 
% of Schools 




Math 
% of Schools 




Less than 


-.22 


' 0 




1 




-.22 to ■« 


.13 


0 




2 




-.12 to - 


.03 


. 1 




1 

r 




-.02 to 
.03 to 


.02 
.12 


"0 
0 




3 
3 




.13 to 


.22 


6 


c 


7 




.23 to 


.32 


8 




15 




.33 to 


.42 


12 




9 




.43 to 


.52 


' 22 




17 


a 


-:53 to 


.62 


21 


1 


14 




.63 to 


.72 


12 




6 




.73 to 


.82 


11 




7 




.83 to 


.92 


6 




4 




.92 and 


above 


1 




11 





9 ?„ 



I 

1 



them do better and a few are very good in the quality of their selection. The 
median coefficient for reading is .53 an£ for math it is .48. It seems -that 
for most purposes this Targeting Index is preferable to that based only on the 
characteristics of the students selected, although it requires more complex 
calculations . { 

Other indexes can be developed. For example', instead of. dichotomizing the 
achievement scores as above or below a certain cut-off, one could use the 
achievement scores as percentiles or as percentile ranks and Compute a point- 
biserial correlation: This has the advantage of using more of the achievement 
information than does the phi coefficient. In Report #13 still other methods 
are considered and lach has its advantages and disadvantages # The index to 
be preferred depends on the use to be made of it and on the^ ability to do com- 
plex calculations. The discussion in Report #13 "includes a table that answers 
a number of questions for each index. The questions considered are: 



Is the indejx based on national or school •norms'? 
Does the iridex consider all the needy students? 

.\rj the schools penalized if they provide CE services to all students? 
Are the schools penalized if they t jrget CE to selected grades only? 
Does the index have a known sailing distribution? 

At first blush the development of a tarring index would seem like a simple 
task but, when seriously considered, it is quite complex. The discussion in 
Report #13 should be helpful to anyone trying to develop a targeting index. 



Is the index easy to calculate? 

Does the index consider the actual receipt of services? 
Does the index consider only CE students? 
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CHAPTER IV. WHAT IS COMPENSATORY EDUCATION? 



Summary 

To describe Compensatory Education we have contrasted the instructional 
services received by CE students with those received by regular students 
in the same schools. It is clear that there are important differences 
in the services received by these two groups of students. Some of the 
important differences are: 

0 Title I students receive services costing about $436 more 
than the services regular students receive. Most of this 
money is spent on teachers , remedial specialists and aides. 

0 Title I students receive considerably more instruction in 
reading qnd math than do regular students. But while the 
, Title I students are receiving this additional reading and 

math instruction the regular students are receiving in- 
struction in these same and other subjects. Thus it is 
not clear that Title I students enjoy a net gain in total 
instruction. 

0 Title 1 students receive their instruction from teachers 
who have had somewhat less teaching experience than regular 
teachers. However, the special teachers have had somewhat 
more coursework and inservice training in teaching methods . 

0 Title I students receive their instruction in somewhat smaller 
classes than regular students. 

0 The major difference between Title I instruction and regular 
* instruction is that Title I students receive less of their 

instruction in large groups in regular classrooms and re- 
ceive much more instruction in small group settings from 
special teachers and aides. 

0 Teachers of Title I studerfbs report using different methods 
and practises in teaching Title I students than do the teach" 
ers of regular students. In reading* Title I students are 
exposed, throughout their elementary grades, to more elemen- 
tary or basic reading methods than are regular students, who 
receive instruction in more complex materials. In the first 
two grades the approaches used in teaching reading are simi- 
lar for Title I and regular students, but then they begin 
to diverge. By the sixth grade the approaches most frequently 
used with Title I students are least frequently used with 
regular students and vice versa. 
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# Teachere of Title I students report a much higher use of 
ixudiovisual equipment in their instruction than do teach- 
ers of regular students. 

We have seen who gets CE but we haven't yet said what CE is. There is no simple 
explanation or description of CE; it is an amalgam of many different programs, 
practices, and services. In the Sustaining Effects Study we have two main sources 
of information about what constitutes CE. First, we have information gained from 
questionnaire material completed by teachers, principals, and district personnel. 
From this survey material we can determine what services regular and CE students 
are reported to receive. Second, we conducted an in-depth study, of 55 poverty 
schools. At these schools we went into classrooms and observed the instruction 
being given to regular and CE students* He talked to the teachers and principals 
about what their programs included. From these site visits we have detailed de- 
scriptive narratives of CE programs. In this Interim Report we axe including 
only two short descriptions to give a flavor of the variety of CE programs in 
different schools. 

School A 

Three discrete Title I program components serve identified students in this 
fairly large, 63-year-old urban school. Hie kindergarten program, which will 
not be described here, serves 48 students. The primary grades 9 Title X Reading 
Program serves 144 students in grades 1-3, while the Computer-Assisted Instruc- 
tion (CAD Lab serves 266 students in grades 4-6 in both r&ading and math. 



The three primary grades* Title X reading teachers share a single huge room, 
where each is scheduled to see six groups of eight students for daily 50-minuti* 
sessions. Each has responsibility for teaching students from a single grade, 
but their teaching procedures are generally the same* Early in the fall, a 
diagnostic test is administered to each pupil. A needs-assessment sheet pro- 
filing the student's strengths and weaknesses is developed based on the results 
of the diagnostic test. On the basis of the needs-assessment profile, the 
teacher develops a separate prescriptive educational plan f *z each child, out- 
lining the sequence of skills to be attacked and materials to be used by the 
student. & 

82 100 m 



Students leave their homeroom classrooms to attend Title I reading instruction. 
Upon arrival at the Title I room, students pick up their work folders^ which 
contain assignments for the week, and start to work independently, calling on 
their teachers when they need help. The teachers also provide some small-group 
instruction daily, usually to subgroups of three to four students who have com- 
mon instructional needs. Skill profiles are kept up to date as prescriptions 
are completed, #nd the diagnostic test is readministered periodically. The 
Title I room is well-supplied with a wide variety of high- technology equipment 
and materials which are called into play in the various prescriptions. Heavy 
use is made of controlled readers, feedback teaching machines, audio tapes, film- 
strips, records, instructional kits, and a variety of texts, workbooks, work- 
sheets, and dittos. 

The CAI Lab is staffed by one teacher and one aide who oversee students' progress 
on the 14 teletype terminals in the lab. The terminals are connected to a mini- 
computer, housed in the school, which serves a number of other schools as well. 

The provider of the 'CAI software also provides a curriculum guide, specifying 

* 

for various levels of performance on the CTBS where students should start in 
the math and reading curricula. The curricula cover 14 levels of difficulty, 
depending upon the students' grade , levels, entry skills, and progress. The 
software also provides a H time-out" feature, whereby repeated slow responding is 
quickly brought to the attention of the teacher. This was perceived to le very 
valuable for keeping the students consistently on-task. 

The teacher and aide monitor student work and provide assistance with either 
cdfttent or machinery as needed by uie students. Hie teacher or the aide reviews 
the summary printed out on the teletype at the end of each student's daily, ap- 
proximately 20-minute session. A student who has received 100 percent correct 
on the ^day 's drill in either subject receives a colorful ribbon award to wear 



work individually with students while they are at the terminals. In some cases, 
if there are several students having trouble with a particular skill, the lab 




back to the regulatf cla&sroom. This is called "The 100 Percent Club." When 
the teacher decided that one or more pupils need additional instruction, help 
is provided in one of several ways. In most cases, the teacher or the aide will 
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teacher will take a small group into the adjoining room, which is equipped with 
a chalkboard and several chairs, and will provide small-aroup instruction on 
that skill. Or* occasion, the CAI Lab teacher will also go into the regular 
classroom during regular math instruction to give a special lesson to an indiv- 
idual or to a group. 

' t \ • 9 School B t 

The Title I program serving grades 1-8 in this small rural school consists 
basically of two full-time Aides who provide tutorial and small-group instruc- 
tion. One aide, who has had one year of college, works primarily with ^econd- 
and third-grade students in- reading and math, and occasionally in spelling and 
penmanship. Due to overcrovding in the school,, she is forced to use about the 
last twenty feet at the end of* a hallway as her classroom. The second aide is 
a former teacher who has beta a Title X teacher's aide at the school for 15 
years. She meets with students from grades 1-8, variously for reading, math, 
spelling, social studies r and penmanship, in * combined of f ice Aitc hen/music 
lounge 



There is fluctuation- during the year in terms of which students see the aides 
for supplemental instruction. Regular teachers send students in need to the 
aides, with a priority being given to those judged to be most needy. One of the 
aides estimated that she had served 43 students for at least six weeks, 11 of 
whom she had worked with for the entire year. Students who are seen on a reg- 
ular and long-term basis tend to be those who- generally have difficulty under- 
standing new concepts as they are introduced in the tegular classroom, and thus 
are behind the other children. Other students are sent on an as-needed basis, 
when their regular classroom teacher sees that they are having difficulty with 
a particular new concept or skill. In such cases, they may go to the aide for 
a few days or a few weeks. Still other children are sent to the aides long 
enouglT to catch up on work they have missed during absences from school. For 
fctudents who attend regularly, the scheduled number of sessions weekly and the 
duration of those sessions varies from pupil to pupil or from small grot? to 
mall group* Seme students see an aide daily, while others go only once 1 week, 
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in sessions ranging from 15 to 45 minutes. The aides work with a maximum of 
five students in * group, and usually with either one or two students at a time. 



He aides fairly i 



The regular classroom teachers generally tell the aides fairly specifically 
what skills neecKwork by their students, with the aides having* more or less 
latitude in selecting the materials and approach to be used depending upon 
their relationships with the particular teachers irivolveflt During the 1978-79 
school year, , no Title I- funded equipment or materials were deceived at this * 
school , but audiovisual equipment and instructional kits, received in previous 
years are available for use toy any teachers in the school. Undoubtedly, in part 
because of their teaching locations, the aides tend not to use any of the equip- 
ment, and^ generally bare their work on whatever texts, workbooks, or worksheets 
are being used in* the regular classroom* 

— * 
The two Title I programs described here are in marked contrast, but even more 

extreme pictures could have been chosen to highlight the differences in intensity 

and content. of the instruction received by students^ all of whom are labeled 

Title I students. Survey techniques tend to lump together students receiving 

quite different services, but in terms of the national program* survey data can 

give a good summary- of the Title I CE program. The material that follows was 

collected by questionnaires completed by the district -staff , by school principals 

and by teachers and are reported in detail in Report #5. ■ 

COMPENSATORY EDUCATION FUNDS — HOW MUCH MONEY IS THERE AND ON- WHAT IS IT SPENT? 

There are many different sources of CE funds; there is money from local, state 
and federal sources. The amount of these funds varies widely from district to 
district and, within a given district, schools vary considerably in the amount 
ahd kind of funds they have available. Title I is the largest single source of 
CE funding, and we will examine Title I in detail throughout this chapter. 

We asked the business managers of the .school districts to describe the amount 
of Title I funds that was spent for various kinds of services during the 1976- 
77 school year. Table IV- 1 shows the different services on which Title I funds 

are spent for reading, math, and common setfyices not associated with either 

* *i * 
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Table IV-1 f w * 

Per-Pupil Expenditures of Title I Fluids* - v x 



* 


Reading 


Math 


Conmon Costs 


* 

Teachers f 


5237- 


$223 




Remedial and Curriculum Specialist , 
Teaching Assistants and Aides 


181 * 


109 


m 

* 


Training of Instructional and Non- 
Instructional Staff. 


11 


16 




Administrative Services, Planning,. 
Evaluation " 


30 


37 




Instructional Supplies (texts, AV aids, 
supplies) 


2G 


21 




New Equipment, Building Alterations, etc. 


47 


.42 




Staff and Materials for School PAC, PTA, 
etc. 






$22 


Other Costs** 

# 
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♦Columns cannot be added since, different schools have, different mixes of 
services. 

**0ther costs include guidance, counseling, health and nutritional services. 



subject. It will be seen that the largest amounts are spent on teachers, cur* 
riculum specialists, teac hing assistants and aides. Smaller, but in the aggre- 
gate, significant amounts are spent on planning and evaluation, supplies, and 
equipment. Important amounts are spent on parent advisory groups, parent-teacher 
associations, and the like. Also, funds go to guidance, Counseling, health and 
nutritional services. While these figures cannot be added up to find the^-expen-; 
ditpires per pupil, since different schools have different mixes of services, 
they represent significant supplementation *o the regular school expenditures. 
For the schools in the SES sample, the av ge annual per-pupil regular expen- 
diture was $1,189, and the average Title I per-pupil expenditure Was *^out $436 
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for Title I students.. -The exact amounts for per-pupil expenditures are difficult 
to obtain because of different ways of counting the number of students receiving 
various services. However, these figures do give an indication of the relative 
degree to which Title. I Students receive services over and beycfhd those given to 
^ regular students. The $436 tie I dollars go to pay for the various services-, 
that will be described throughout this chapter. There can tfe no doubt that 
Title I students receive instructional services different from those received 
by regular students. " * * 

jr 

* 9 

What are these instructional services? In the -elementary grades they are largely 
reading and math instruction* Thus, much of this chapter will be devoted to com- 
paring the amount and kind of instruction received by regular and CE students in 
reading and Math. The school setting in which CE instruction is given varies 
Significantly from school to school. Our approach to defining CE is to ask what 
services CE students receive in contrast to those received by regular students. 
Thus, throughout this chapter we will be conparing the amount of instruction CE 
students received with that received by regular students; we will compare the 
kinds of teachers giving instruction to CE students with those giving instruc- 
tion to regular students; w-^ will contrast the instructional approach and tech- 
niques used with CE students with those used with regular students. 

HOUBS OF INSTRUCTION - ^ 

Generally the number of hours in the school day is fixed, with CE students and 
regular students in a school receiving a similar number of hours, but the amount 
of ^instruction CE students receive in reading and math is different from the 
amount of instruction received by regular studerfts. Figure IV- 1 shows the num- 
ber of hours, of reading instruction received by three groups of students: Title I 
students, regular students in the same sdhools, and students in schools that doj 
not h$ve any CE students. The figure shows that in the first and second grades 
Title I students and regular students in Title X schools receive essentially the 
same amount of reading instruction. However, students in schools not having CE 
programs (and thus probably being in more affluent attendance areas and having 
somewhat higher-achieving student*) are, even in the first and second grades re- 
ceiving, and presumably needing, fewer hours of reading instruction. Starting 
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Figure IV-1* Hours Per Week Devoted to Reading Instruction for Title I and 
Regular Students in Title I Schools and Non-CE Schools 
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in the third grade and continuing through the sixtA grade, Title I -students 
receive much more reading instruction t^ian regular students "in either Title I 
or rion-CE schools. / 



Since CE students spend more of their time on reading instruction than regular- 
students, are the| CE students missing out on other instruction? Figure IV-2 
shows the amount of reading-related activities received by Title I and regular 
students. Reading-related activities are in addition to ^regular reading and 
include spelling," vocabulary study, grammar, and writing. ' Ifseems that the 
Title I students spend a little less time in reading-related actiyities than 
regular stud^ftts, but» the difference is only about a tenth of an hour a week 
while the difference in reading instruction is as much as 1.8 hours per week. 

9 - £ 

We asked reading teachers, "When students are participating in compensatory 
reading activities, in what types of activities cure their non-participtfnt peeas ^ 
involved?** Teachers were asked to check all items that applied. The response 
from grade to grade tended to be quite similar. A majority checked other read- 
ing activities, 30 percent checked math activities, about 45 percent checked 
activities related to other subject matter areas, about 30 percent checked 
"study time," and about 25 percent checked "student selected activities." About 
15 percent checjifed "visits to the library," about 5 percent indicated physical 
education activities, and about 2 percent checked "field trips." Thu#, while 
the CE students get more heading "instruction, they are missing other instruc-^-^ 
tion. Given the fix^d length of the school day, this is almost inevitable and 
it means that regular students get more instruction in other subjedt areas than ; 
CE students. Reading is basic, and CE students need instruction in reading, 
but they pay a price for it in terms of other instru5#io^missed. 

i 

i 

Figure IV-3 shows that Title I students rjeceive much more instruction in mailt * 
than do regular students. On the average,, regular students receive about 4.8 
hours per week of math instruction while CE students receive about 5.8 hours 
per week; the difference in^favor of the CE students starts in the first grade 
and continues through the sixth grade. In reading we saw a sharp decrease in 
hours- of instruction as grade increased, but in math this is not the case; in 
math there is a very slight tendency for hours of instruction to increase from 
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Figure IV- 3. Hours Per Week Devoted to Math Instruction for Title I Students 
and Regular Students in Title I Schools and Non-CE Schools 
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the first to the fifth grade and then to drop in the sixth grade. Math teachers 
were also asked to indicate what the regular students did during the time when 
C£ students wore receiving additional math instruction. The results are very 
similar to those reported for reading. The regular students are involved in 
other aath activities, reading activities, activities ir other subject areas, 
general study time, and student-selected activities whi'.e the CE students are 
studying additional math. 

In sunmarizing the results for hours of instructional service, it is deal that 
CB students receive very significantly more hours of reading and math instruc- 
tion than do regular students. But while the CE students are receiving this 
additional instruction the regular students are Alten receiving instruction in 
these and other Subjects. Thus, CE students have a gross gain in reading and 
math instruction, but it is questionable whether they have a net instructional 
gain when the whole range of curricula is considered. 

CLASS SIZE 

CE students receive more instruction in reading and math than^do regular students, 
but is it of the same or a different quality? One measure of quality is the sise 
of the class in which the instruction is given. Figurfc IV-4 shows the average 
class size by grade for Title I students and for regular students in Title I 
schools. It will be seen that for both reading and math the size of the class 
increases as grade increases. It is also apparent that classes composed of CE 
students are smaller than similar classes of regular students. The differences 
are not large, but even a difference of one or two students should result in 
so— what more individual attention for the CE students. At the elementary level 
much of the instruction in basic subjects is not given to the whole class but 
rather to smaller gro^s of students. Figure IV-5 shows the way in which read- 
ing instruction is given in terms of the use of subgroups of the full class. In 
the first four grades almost all of the reading instruction takes place in a sub- 
group setting and even in the fifth and sixth grade subgroup instruction is the 
pred oa dnant mode of instruction. The use of subgroups characterises instruction 
for both Title X students and regular students. There is some tendency for the 
use of subgroups to decrease as grade increases, and there is a tendency for 



92 110 



55 



SOURCE: REPORT 5, TABLE 4-17 



50 



O 

O 
Z 

5 
< 

UJ 

C 



i 



z 

Ui 



2 



20 



18 



10 




SINGLE 
GRADE, 
SAME 
LEVELS 



SINGLE 
GRADE* 
DIFFERENT 
LEVELS 



NO 

SUBGROUPS 



REGULAR STUDENTS 
TITLE I STUOENTS 



•PERCENTAGES FOR GROUPS DO NOT ADD T0 100% SINCE 
SEVERAL INFREQUENT COMBINATIONS HAVE SEEN OMITTED. 

t t I I . I L 

1 2 3 4 S 

GRADE 



Figure IV-5. Percentage of Students In Various Types of 
Subgroups for Reading Instruction for Title I and 
Regular Students in "title I Schools* 
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regular students to be more frequently in groups composed of students at similar 
levels of achievement than is the case with Title I students. 

s 

A figure similar to Figure IV-5 for reading could be presented for math, but the 
six lines cross so much that- the figure would be more con fusing t han il luminating. 
The interested reader can refer to Table 4-17 in Report #5 for detailed figure^. 
The general results are that fbr math, grouping is used considerably less fre- 
quently than it is ifT reading. For Title I students math instruction is given 
in groups' about 70 percent of the time while for regulaJ: students the figure is 
about 60 percent. 

In summary it can be said that Title I students receive their instruction in 
soritewhat smaller classes than regular students. Much of the instruction in 
reading is given in subgroups rather than to the whole class, and there is a 
tendency for Title I students to receive subgroup instruction in groups of stu- 
dents of differing achievement levels when compared to regular students. For 
math the situation is somewhat different with more of the instruction being whole 
class instruction, but when groups are used we ^gain see that the Title I groups 
are of differing achievement levels. ' ( % 

WHO TEACHES TITLE I AND REGULAR STUDENTS? 

In trying to understand what compensatory education is, we have examined the 
amount of instruction received by CE and regular students and found that CE stu- 
dents receive more reading and math instruction than regular students. We have 
also found that CE students receive their instruction in slightly smaller classes 
than regular students. We now examine whether or not Title I students and reg- 
ular students receive the instruction from similar or different teachers. 
Table IV- 2 shows a number of characteristics associated with teachers in various 
classroom settings. 

in our sample of schools about a tenth of the teachers were in non-CE schools. 
Among the reading teachers in CE schools 17 percent teach only CE students, 60 
percent teach both CE and non-CE students, and 23 percent teach non-CE students. 
The corresponding figures for math teachers are 11 percent, 43 percent, and 46 
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Table IV- 2 

Average Experience and Training of Teachers 



__-~Stt06hts Students CE School Non-CE School 



Roadix 



Percentage of Teachers Who 
Were: 

Percentage of Teachers in CE 
Schools Who Were: 

Number of Years Teaching in 
Any School 

Number of Years Teaching in 
Current School 

Highest Gained College Degree* 

Nuaber of College Courses in 
Teaching Reading 

Nuaber of Hours of Inservice 
Reading Training 



Math 

Percentage of Teachers Who 
were: 

Percentage of Teachers in CE 
Schools Who Were: 

Nuaber of Years Teaching in 
Any School 

Nuaber of Years Teaching in 

Current school 

Highest Gained College Degree 

Nuaber of College Courses in 
Teaching Hath 

Nuaber of Hours of Inservice 
Math Training 



Teaching Teach ing Teaching 
Teaching Both CE Only_NoaeCE_—-0«ly Non-CE' 



Ojily CE 



Students in Students in 



15 
17 

10.3 

6.1 
2.6 

1.9 

14.3 



10 

11 

9.3 

-5.8 
2.5 

.9 

8.2 



54 

60 

11.2 

6.8 
2.4 

1.3 

12.0 



38 

43 

10.8 

6.6 
2.4. 

.7 

9.0 



21 

23 ' 
11.0 

6.6 

2.5. 

1.1 
10.2 



\ 



40 
46 

11.5 

7.1 
2.5 

.5 

5.5 



11 



11.9 

6.6 
2.5 

1.2 

10.9 



12 



11.9 

6.7 
2.5 

.6 

-6.9 



*1 ■ less thrn 4 yearr of college, 2 ■ bachelor's degree, 3 » 5-year preparation, 
■aster's degree, or 6 years specialist degree, 4 • doctor's degree. 
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percent. Thus, we %ee that in reading in CE schools most teachers ^each both 
CE and non-CE students, while roughly a fifth teach only CE students and another 
fifth teach only regular students. In math the situation is somewhat different. 
1her-» are somewhat fewer math teachers in CE schools who teach only CE students, 
but there is a considerably higher percentage of math teachers who teach only 
non-CE students. 

For both reading and math, those teachers yho teach only CE students have had 
less total teaching experience and less teaching experience at their current 
schools. However, those who teach only CE students have slightly more college 
education, have more college courses in teaching, and somewhat more inservice 
training than other teachers. Presumably sych training should make these teach- 
ers more effective. On the other hand, the regular teachers have had more teach- 
ing experience, which should make them more effective. In Report #10 the one 
teacher characteristic which seems to be associated with greater student achieve- 
ment was the amount of teaching experience of the teacher* thus, to the extent 
that Title I students are receiving their instruction frca less experienced teach- 
ers, and our evidence suggests this is the case, they may be at some disadvantage 
relative to regular students* ** 
*■ 

IN WHAT INSTRUCTIONAL SETTING DO TITLE I AND REGULAR STUDENTS RECEIVE INSTRUCTION? 

As already indicated instruction can be given in many different settings. It can 
be given to the whole class in the regular classroom by the regular teacher, or 
it can be given in small groups by a special teacher, or in a special room by a 
special teacher, and any number of other combinations • Four times a year we 
had teachers complete a Student Participation and Attendance Record which, for 
each student, gave us a report on the setting in which the student received in- 
struction* From this record we can compare the setting in which Title I students 
and regular students in Title I school* received instruction. Figure IV-6 shows, 
by grade, the hours of instruction for Title I and regular students in the reg- * 
ular whole classroom setting by the regular teacher It will be seen that Title I 
students receive considerably less instruction in reading in this setting. Fig- 
ure IV- 7 shows the same thing for math instruction with the same results. Fig- 
ures IV-8 and IV-9 show the amount of instruction in reading and math with the 
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regular teacher when the class is broken down into smaller groups. For reading, 
both Title I and regular students receive about equal amounts of instruction in 
this setting, but for math, the Title I students receive considerably more in* 
•truction f- » the regular teacher in small groups than do the regular students. 
Figure* IV- 10 and IV- 11. show the amount of reading and math instruction given by 
special teachers and aides (usually in a mall group setting) for Title I and 
regular students. It will be noted that the Title I students receive much more 
instruction in these settings than do regular students. Firmly, Figures IV- 12 
and IV- 13 show the amount of instruction where the student is working alone with- 
out the immedftte assistance of a teacher -or aide. It will be noted that regular 
students engage in considerably more of this kind of learning than do Title I 
students. This should be to the advantage of the Title I students since they 
should learn more when being actively taught rather than when working by them- 
selves. 

• * 

He" have included so many graphs on this subject becMgej#e think it presents 
one of the most important instructional distinctions between Title ! and regular 
students. It should be remembered that all of these students come from the same 
Title I schools. The graphs show clearly that in both reading and math Title I 
students receive lees instruction from the regular teachers in whole classroom 
settings and that Title X students spend much less time working on their own with 
workbooks, dittoed sheets, etc. 3ut the most significant difference is that, in 
contrast to regular students, Title I students receive much, more instruction from 
special teachers and aides in small groqp settings. The Title I dollars largely 
go to buy this difference in instructional personnel and setting, a setting that 
should be favorable to learning. (In Chapter V we will see whether this is in- 
deed the case.) 

ARE THE TYPE MB) CONTENT OF INSTRUCTION DIFFERENT FOR TITLE I STUDENTS? 

We have seen that the services given Title I students and regular students differ 
in terms of total hours of instruction, slse of classes, experience of the teach- 
ers, and the setting in which instruction is given. We will now examine the in- 
structional practices used by teachers to see it the way instruction is given 
differs between Title I students and regular students in the same schools. 
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Figure IV- 13. Annual Hours of Math Instruction Received by Title I 
and Regular Students by Individual Seat Work in Title I Schools 
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Teachers were asked a series of questions about how they gave instruction in 
reading and math. Teachers were asked, M T0 what extent are the following aspects 
of your reading (or math) instruction basically the same for all or most of your 
students?" They could mark "basically the same for most'of the students" or 
"tends to vary among students." Table IV-3 shows the percentage of students 
whose teachers reported that instruction varied in a number of areas. In con- 
trasting Title" I students and regular students we see that there were a number 
of areas where instruction varied more for Title I students than for regular 
students: the amount of time spent in instruction tended to be more variable 

Table IV-3 

Percentage of Students Whose Teachers Report That Instruction 
Varies Among Title I and Regular Students in Title I Schools 



Reading Math 



Type of Instruction: 


Title I 
Students 


Regular 

Students. 


Title I 
Students 


Regular 
Students 


Total Time in Subject 


32 


29 


32 


23 


Instructional Objectives 


62 


54 S;-.r \. - 


50 


37 


Sequence of Activities 


56 


48 


46 


34 


Expected Rate of Progress 


91 


92 


89 

* 


85 


Teaching Method 


72 


69 


64 


54 


Types of Instructional 
Materials 


68 * 


62 


56 


44 


Content of Instruction: 










Based on Approved 
Curriculum 


33 


43 


32 


46 


Based on tested needs 
assessment 


19 


11 


22 


10 


Both approved curriculum 
and needs 


48 


46 


45 


43 
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for Title I students, particularly in math; the instructional objectives tended 

& ... 
to be more variable for Title I students; the sequence of activities was more 

variable, again particularly in math, as were the teaching methods and the types 
of instructional material*. Most teachers of both Title I students aw* regular 
students expected the students to show aqual amounts of variation in their rates 
of progress. In terms of the content of instruction there was considerable vari- 
ability. There was considerably lees use of an approved curriculum for Title I 
students than for/ regular students. In the case of Title I students there was 
a considerably more frequent use of a curriculum devised in terms of a test- 
based needs-assessment rather than on the standard approved curriculum. As grade 
increased there was such lies use of the approved curriculum for Title I students 
and much greater resort to instructional material based on a needs-assessment. 
Table IV- 3 shows that there is a noticeably greater effort to individualise the 
type and content of instruction for Title I students than there is for regular 
students. Many believe this should be a positive factor leading to greater 
learning. 



ARE THE READING AW MATH ACTIVITIES OF TITLE I STUDENTS DIFFERENT FROM THOSE OF 
REGULAR STUDENTS? 

1 ' * 
As we progress we are examining in finer detail the actual activities that the 

teachers upe in teaching their students. It is the actual instructional process 

1 \ 

used that determines the intellectual content or material that the student re- 



ceives. 



ichers were asked to describe the frequency with which they engaged 



in a variety of instructional activities. ' There were twelve different reading 
activities which the teachers described as being used "very frequently" (scored 
5) to "never or almost never" (scored U. The teachers responded on a five- 
point scale. 

l 
1 

The following activities were used with, great frequency in the first grade, and 
their use progressively declined through the sixth grade. Also, these activities 
tended to b+ used more frequently with Title I students than with regular stu- 
dents. The 'activities werai 

Identifying aid practicing letter-sound correspondence 
Identifying and writing letters or groups of lettej-s 
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Blending sounds letters stand for to form words 
Learning and practicing sight words 
Reading texts orally 

These are all basic activities and are ones students start with in the first 
grade, where these activities were rated about 4.5 on a I'ive-poixit scale. While, 
these activities decrease with grade they are still being used "sometimes" in 
the sixth grade, but they are being used considerably more frequently with Title I 
students than with regular students. 

Similarly there was a group of activities that was used relatively infrequently 
in the first grade, but its use increased in the higher grades. These activi- 
ties were: 

Dividing words into syllables 

Answering comprehension questions on timed reading 

Using reference materials such as dictionaries *and encyclopedias 

These are more complex activities than those in the previous list* There is 
some tendency for regular students to engage in these activities more frequently 
than Title I students, as might be expected since the regular students are 
achieving at a higher level than the Title I students. Finally there was a 
group of activities that showed no increasing or decreasing trend with grade. 
The following two activities were engaged in frequently in the first grade and 
throughout? the elementary grades: 

Using context clues "to gain "meaning 
Answering questions on comprehension 

' The following activity was low in the first grade and then at the "sometimes" 
level in the remaining grades: 

Reading and writing stories created by self or other students 

In s unitary, there are a number of different processes used in teaching reading. 
Basic processes are used very frequently in the lower grades but are used with 



decreasing frequency as grade progresses. However, Title I students at the 
higher grades continue to be instructed through the use of more of these activ- 
ities than do regular students. More complicated reading processes are used 
infrequently in the loner grades and more frequently in the higher grades, 
there is a slight tendency for Title I students to he instructed in these activ- 
ities less frequently than regular students. 

Since learning to read is such an important part of a child's education, we 
gathered extensive Aata on teachers' prapticus in teaching reading. We wanted 
to see if teachers used different practices in teaching Title I students from 
those they used vith regular students. He have just seen that there are signif- 
icant differences in the activities that are most frequently used. We went fur* 
ther and attempted to see within these activities if there were particular 
approaches that were favored by teachers toaching Title I children. For each 
approach teachers were asked to indicate whether the approach was "uaed as a 
major approach," which was scored 3j was 'used as a s e con dary approach," and 
was scored 2; or was "not used," and scored 1. Listed below are approaches 
that increase with increasing grade and which are ftlso used more frequently 
with Title I studen t*? — The appro aches are listed in the order of the difference 
in their use for Title I and regular students. / 

1. An approach that uses a modified alphabet system which either augments 
or marks the regular alphabet so that it corresponds more closely to 
the sounds of the language. 

2. A self-instructional approach that uses a series that presents material 
in 'frames' containing small bits of information to which the children 
are asked to respond. Tiifl ate confirmation as to the correctness of 
their answers is given in the text. 

3. An approach in which children select their own reading materials, such 
as library-type books, and receive instruction primarily through 
teacher-child conferences. 

4. An approach that uses a reading series and/or library- type books to 
teach forms of literature and literary appreciation* 
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5. An approach in which children read their own writings. These 'stories' 
provide the material on which reading instruction is based, 

-6. An approach that includes reading in the content fields, such as science 
and social studies; teaching of study skills, such as how to use tables 
of content, indices, graphs, dictionaries, encyclopedias, etc., and how 
to organize materials into outlines, summaries, and reports. 

There was only one approach that was used more frequently in the first few grades 
and was then used less frequently as r~ ade increased, This approach was also ^ 
one which was used by teachers of Title I students much less frequently than 
with regular students* J 

7. An approach that uses a graded reading series containing a vocabulary 
based upon words that occur frequently in the language* New words are 
introduced by sight and by a phonic anal/sis presenting the letter- 
sound relationship of consonants before that gf vowels. 

/ "\" 

There were two approaches that were used as frequently in the hither grades as 
in the tower grades, but these approaches were used significantly More frequently 
with Title I students than with regular students. 

8. An approach that uses a graded reading series containing a vocabulary 
based primarily upon words that are regularly spelled. The most com- 
mon patterns, these containing short vowels, appear first, a typical 
sentence in an early reader beings Nat is a fat cat. Gradually, more 
complicated, less frequent patterns are introduced. New words are 
learned by analysis of spelling patterns of by sounding and blending. 

9. An approach that uses a graded reading yaries containing vocabulary 
that rapidly introduces the letter-sound relationships of all the 
sounds in the language* Long and short vowels are introduced at the 
onset. New words are learned by sounding and blending. 

*- 

Finally, there was one approach which differed by having one trend for Title I 
students and a different one for regular students. This approach was used w'.th 

equal frequency for both groups in the first grade, increased with frequency of 

4 
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use in the second grade and for regular students continued to increase to the 
sixth grade. But with Title X students its use decreased after the second grade 
and was lower in the sixth grade than it had been in the first grade. 

10. An approach that uses a reading series and/or other books to teach 
both literal coaqprahension "and understanding of implied meanings in 
the text. 



the previous results have been presented in 'terms of changes in frequency of 
use of the various approaches as grade changes and in terms of the sixe of the 
differences in use with Title X and regular students. This presentation may 
give e wrong impression regarding the frequency of use of the various approaches . 
The frequency of use varies greatly frost the first grade to the sixth, in the 
first grade the same approaches tend to be used with Title I students as with 
regular students, but the differences increase with grade. The following list 
gives the rank order of the frequency of use of the approaches for Title 2 and 
regular students in the first grade. The approach listed first is the most- 
used approach while the last one is least used. (In the list the number is 
the one used in the text above to identify the description of each approach 
while the short sentence is a capsuled statement tf the major characteristics 
of the approach.) 



Title I Students in the First Grade 

7. Graded sight phonic analysis 

9. Graded letter-sound relationships j_ 

10. Literal and implied comprehension 

8. Graded spelling, sounding/blending 
_ 4. Literary forme and appreciation 

5. Students read own writing 

1. Modified alphabet 

3. students select own materials 

6. feeding in content fields 

2. Self instruction with reinforcement 



Regular Students in the First Grade- 

7. Graded sight phonic analysis 

10 . Literal and implied coapreheneion 

9. Graded letter- sound relationships 

8. Graded spelling, rounding/blending 

4. 'Literary forme and appreciation 

5. Students read own writing 

3. Students select own materials 

2. Self instruction with reinforcement 

6 . Reading in content' fields 
1. Modified alphabet 
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As the list shows, the frequency with which the approaches are used is about 
the^same for Title I students and regular students in the ^irsF^radeT ~Ph6nics, 
letter-sound relationships , and comprehension are the three roost frequently used 
approaches for both groups in the first grade. Among the least frequently used 
approaches are modified alphabet, reading in content field, and self instruction, 
those who are strong advocates of phonics should be pleased to see that it is 
; the most frequently used approach tor Title 1^ students and regular students in 
the first grade. But what happens as grade increases? The following list shows 
the rank order of the same approaches for students in the sixth grade. 

Title I Students in the Sixth Grade Regular Students in the sixth Grade 



1. 


Modified alphabet 


10, 


Literal and implied comprehension 


2. 


Self instruction with reinforcement 


6, 


Reading in content fields 


5. 


Students read own writing 


4. 


Literary forms and appreciation 


3. 


Students select own Materials 




1 Graded sight phonic analysis 


4. 


Literary forms and appreciation 




Students select own materials 


6. 


Heading in content fields 


9. 


Graded letter-sound relationships 


8. 


Graded spelling, sounding/blending 


8. 


Graded spelling, sounding/blending 


9. 

i. 


Graded letter-sound relationships 


2. 


Self instruction with reinforcement 


10. 


Graded sight phonic analysis - 

, Literal and implied comprehension 


J • 
1. 


-SLudeii thread own writing 
Modified alphabet 



In this list for the sixth grade the contrast between the approaches used for 
Title I studente and regular students is striking. The first three approaches 
used with Title I students are the la^C^hree used with regular sixth grade 
students. The three mdSS^hnrfTfefrroaches with regular students are- the last " 
tWree approaches used with Title I students. It seems that the most-used ap- 
proaches with regular students in the sixth grade are advanced approaches, that 
is, they assume a mastei/ of elementary reading and emphasize comprehension , 
literary form and conteyit-^ t three approaches with Title I 

students are different* Students who ar* having reading difficulty are exposed 

/ ! 

to approaches emphasizing modified alphabet, self instruction, and reading their 
own writing. And this is no fluke" of the data. The list for the fifth grade i<3 
almost identical, with the first three items for the fifth grade being the same 
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ones as for the sixth grade for both Title I students and regular students* It 
seems that Title X students are much more frequently taught by special teachers 
and aides and are assigned to self instruction and the reading of their ov * 
writing in the higher grades. As researchers we are not reading specialists, 
but this ordering of approaches may not be the best. We believe it would be 
useful for these data to be explored in depth by reading specialists to see if, 
in their judgment, the proper approach is being taken to teaching reading to 
Title I students in the higher grades. 

In summarizing this material on the practices used in teaching reading it is 
clear that both the activities engaged in and the approaches used vary cons id- . 
erably with grade. Some practices are used more frequently as grade increases, 
others are used less frequently, and some retain about the same frequency. For 
many of the teaching practices there are clear differences in the activities 
, and approaches used with Title I students and with regular students, and this 
varies with grade. Some of the practices used with Title I students in the 
higher grades do not have intuitive appeal and should be studied in detail by 
reading specialists to see if the best approaches are used with Title I students. 

For math the trends are not as strong as they are in reading. The activities 
that are used relatively frequently in the lower grades and less frequently in 
the higher grades are, in the order of their frequency of use: 

Learning about nusber sentences 
Learning about sets . 
— Learning symbols 

Working with physical models 

\ 

To those of us who were in elementary school a nusber of years ago this is a 
surprising list. That learning about number sentences and about sets should be 
high in the first grades and then decrease does not fit our expectations • The 
activities which are low in the first grades and increase as grade increases 
are, again in order of most uses 

• 
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Reviewing computational skills 
Learning about number theory 
Learning about measurement 
Learning properties and axioms 

Again speaking as laymen in math instructional theory, it seems appropriate^ that 
computational skills should be emphasized in the early grades, but it is sur- 
p^islng tha£ it increases up to the sixth grade* It is surprising that number 
theory is emphasised early. 

Activities which are flat and ordered from high to low use ami 

Learning about fundamental operations 

Learning math vocabulary 

Learning geometric concepts 

Learning about structure of number systems 

One filial activity, solving word problems, starts with a low frequency in the 
first grade, then increases through the second, third and fourth grades, and 
then decreases* There are small differences between Title X and regular* stu- 
dents in terms of the activities used in their math instruction. Relative to 
regular students, Title 1^ students receive more " learning about the structure of 
number systems," "working w>th math games," "working with physical models," and 
"learning about sets." While these differences are not large, it surprises us 
that, they are emphasized with Title I students. 

DO TEACHERS USE MATERIALS AND EQUIPMENT DIFFERENTLY WITH TITLE I AND REGULAR 
_ STUDENTS T 

in teaching reading and math, teachers use a number of different approaches to 
teaching. They all Use some kinds of materials and equipment. Among the mate- 
rials used by teachers are regular texts, supplemental readers , 'free reading 9 
books, reference books, workbooks, dittos, programmed texts, games, puzzles, 
geoboards, and many others* We cohered the us* of these materials for regular- 
achieving students and low achievers and found some differences although all 
these materials were used with all kinds of students. There was a slightly 
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smaller use of texts with low-achieving students and a slightly larger use of 
programed materials. As a general rule it seemed that the low-achieving stu- 
dents were given more instruction with materials that were obtained in addition 
to the regular text material. The same tendency was definitely the case with 
equipment such as sound projectors, individual viewing equipment, tape recorders, 
listening centers , special reading machines, study carrels, etc. Title I stu- 
dents receive much more instruction through the use of equipment than do regular 
students as is shown in Figure IV- 14. If such use cff equipment is effective. 
Title I students should certainly show achievement improvements. 



What is compensatory education? there is no single thing that can be called 
compensatory education. Zt is a whole series of things which are different in 
the education of CE students than would have been the caee if they had been reg- 
ular students. The instruction of Title I students differs from regular students' 
in the following respects i 

Title Z students receive services costing about $436 more than the 
services re gular s trtBsnts receive. Most of this money is spent on 
teachers, remedial specialists and aides. 

Title Z students receive considerably more instruction in reading 
and math than do regular students. Bat while the Title Z students 
ere receiving this additional reeding and math instruction the reg- 
ular students are receiving instruction in these same and other 
subjects. Thus, it is not clear that Title Z students enjoy a net 
gain in total instruction. 

Title Z students receive their Instruction from teacher! who have 

- had somswhat less teaching experience than regular teachers. How-* 

ever, the epeciai teachers have had somewhat more coursework and 
inservice training in reaching methods. '~\ 

\ 

Title Z students receive their instruction in somewhat settler 
classes than, regular students. \ 

The major difference between Title Z instruction and regular' in- 
struction is that Title I students receive lees of their instruction 
in a large group in the regular classroom and receive much more§ 
instruction in a small group setting from special teachers and 
aides. 

Teachers of Title Z students report using different methods and 
practices in ' te a ch i n g Title Z students than do the teachers of 
_ _ regular students. Zn reading, Title z students axe exposed, 
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Figure IV-14. Use of Readina and Math Equipment by Titl^ I 
^ and Regular Students in Title I Schools 
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3 throughout their elementary grades, to more elementary or basic read- 

ing methods than are regulator students, who receive instruction in more 00 
J conplex materials. * In the first two grades the approaches used in 
* teaching reading are similar for Title I and regular students, but 
then they begin to diverge* By th* sixth grade the approaches most 
frequently used with Title I students are least frequently used with 
regular students and vice versa. 

V 

Teachers of Title Z students report a much higher use of audiovisual 
t equipment in their instruction than do teachers of regular students. 

.* 

Our results show that there are clear and significant differences in the inatruc- 
tion received by Title I student* and regular students. In the next chapter we 
will see whether there is evidence that these differences lead to greater 
achievement. 




CHAPTER V, HOW EFFECTIVE IS -COMPENSATORY EDUCATION? 
Surfrnary * " 

This chapter is concerned with the amount of achievement growth 

resulting from Title, t services. First, a hypothetical example 

t - — — ->— ■ * 

is given to illustrate the problems inv Ived in forming ^proper 
comparison groups, and also to shew the watf students change 4n 
CE status from year to year. The example will aid in understand- 
ing the major results. The results ari presented by comparing 
the rate of growth of Title I students with the rate of growth 
of Regular Needy students and Regular students. The results 
show; ^ # 3 

«# 

, f In reading* in grades 1 3 2 3 oriel 3* Title I students 
grow at a faster rate than 7 similar Regular Needy 
students. In grades 4, 5, and 6 3 the Title I stu- 
dents grow at the earn rate <*s Regular Needy sti 
dents. 

e In math s for all grades from 1 thru 6* Title I stu- 
dents grow at a faster rate than similar Regular 
Needy students. 

■\ 

e Titl* I students usually grow at a rate that is 
cimilar to the rate of growth of Regular students. 
Nevertheless* the gap between Title I students and 
Regular students widens as grade increases. It is 
shown that this increasing achievement gap is to a 
considerable extent arti factual. 

School^ principal, and teacher characteristics {as well as 
instructional practices)* associated with achievement growth were 
examined. It woe found Uaa ' 

e Greater experience in teaching is related to- higher 
student growth in both reading and math. 

e The amount of regular instruction and tutor/indepen- 
dent work shows some positives but modest 3 effects 
on achievement growth. In contrasts the amount ofr 
instruction by special teachers or instruction in 
very small groups does not often contribute to the ex- 
planrrHgn.of achievement growths and when these do 
negative relationships are observed. 
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# In bot> reading and math, the disruption of insirua-- 
turn nda to be on unfavorable condition for learn- 
ing in the upper grades but not in the earlier grades. 

0 Frequency of feedback on student progress sometime 
relates positively to reading and math achievement 
growth. 

0 In reading only, a teacher 9 s effort in planning and 
evaluation shoos a positive relationship to achieve- 
ment growth in some grades. 

tie have now examined tfc* questions of yho receives compensatory education and 
What* constitutes compensatory edrca „ion. He will now explore the evidence on 
the effectiveness of CE. But before, we do so we should ask how we will judge 
CB*s effectiveness. What do we expect CE to achieve? Students receiving CE 
are doing so either because tests shpw that their lavels of achievement are^ 
low or because teachers ^udge that their performances are loir and they would 
benefit from CE services. . Bow such do «• expect the* to benefit? Some would 
say that if their performances improve at all then the cost of CE is justified. 
This is an absolute criterion in the sense that we are simply asking for some 
improvement ov*r the student's previous level of performance* But they will 
grow in achievement even without CE, so we uiually require that CE result in 
an ij^rovmrnsnt greater than would have been achieved had the students not had 
CE- But how do we tell how much the student would have improved without CE? 
We need sosm kind of a comparison standard. With the use of a co^arison . 
standard the judgment of improvement has changed from a requirement of absolute 
change to a relative change. What is an appropriate comparison group? Some 
will say that they would like ds students to improve enough to equal th* per- 



of their peers , presumably meaning the average performance of tfa* non- 
CE students in the tchool or class. his is probably an unrealistic expacta- 
tiont . some individual students may make such gains but not the average of all 
the CE students. 

Another comparison group might be made up of students who are similar to the 
st^ucunt* receiving CE in initial performance scores and home background. In 
this case we ask that those students receiving CE for a period of time show 
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performance scores which are superior to the comparison group of similar stu- 
dents who have not received CE. Many i# -id be encouraged if we could simply 
show dene improvement relative to the comparison group even if it were , not 
large. In theory it would be possible to form such comparison groups and after 
students have received OS services for a year or two to determine how much the 
CE students have benefited* In practice this is a very difficult thing to do. 
It will be worthwhile to ^understand why this is the case. 

The first problem is one of definition* In this chapter and in several 
that follow we will h* presenting data on the relative performances of groups 
of students that we call 'Regular Students/ 'Regular Needy Students 1 and " 
'Title I Students. 1 By Title >I students we mean those students who are re- 
ported by their schools to be -designated to receive" Title X. services. The 
amount of services varies from student to student as does the nature of the* 
services, but, as we saw in Chapter IV, these students as a group 'do in fact 
receive vore hours of reading and math instruction in a different context than 
other students in the game sch /is. By Regular Needy students we mean fiftu- 
dents who are not receiving CE services but: are judged by their teachers to 
n eed ajuch services; in other words, they are receiving only regular instruction 
<9*en -hough they have an educational need for additional services* .By Regular 
students we mean the remaining students in a school or class who are receiving 
Regular instruction it would seem that these groups of students hxe fairly 
* clearly defined.**' They are at any one period of time, but when one e^nsiders 
the progress of"a student through several school years, the student may, from 
time to time, belong to all three groups. For example, a student might be a 
regular student in grade 1 and do rather poorly. In grade 2 the student might 
be judged as in need of CE bu: not receive any CE services because /there are 
insufficient resources available for this particular student. In^grade 3 the 



♦Except for the Regular students. In some comparisons Regular students kre 
all the students in a school except for the CE students. At other times 
Regular students are the students remaining after the CE students and Regular- 
Needy students are subtracted.. The text will make clear. which definition 4s 

v being used. Another group of students, not considered in this chapter, are 

^students receiving other than Title I C& services. 




student may still be educationally needy , there may be resources available , 
and the student may become a Title I student. Thus, in 1 three years this stu- 
dent has been a Regular student, a Regular Needy student, and a title X student. 
Or consider the f fcudent who performs at the 25th percentile on a test at the 
beginning of the first grade and is designated a Title X student. Because of 
Title X services this student's performance improves, and in the spring he . 
scores at the 35th percentile. Next year in the second grade there are many 
needy students below the 35th percentile so the student is 'promoted out 1 of 
Title X. The student is still soma ^t needy but not among the most" needy and 
thus is no longer a Title X student. Xt is easy to follow the changing classi- 
fication of individual students, but in an evaluation of the effectiveness of 
CE we are dealing with thousands of students in each classification and th* 
change of students from one category to another makes the formation of com- 
parison groups extremely difficult. 

A HYPOTHETI CAL EXAMPLE 

In this chapter, and in later ones, we will be presenting tables and graphs 
to show the relative achievement gains of different groups of students. To 
help in understanding the meaning of these graphs and tables, and to illus- 
trate how they have been derived, we present a hypothetical illustration. 
In the 1 Example School, 1 during -the first year. Jure was only a single third 
grade class consisting of eight students. Table V-l shows these eight stu« 
dents and their fall percentile scores on an achievement test* Based on these 
achievement scores the school classified the eight students as follows: A, ?, 
C and 0 wars classified as Regular students because they scored above the 50th 
per Atile and were Dt in nmed of GB services. Students B and if, who had 
scores of 35 and 30, were judged by their teacher to be in need of CE but 
since the School has only enough resources for two Title X students, students 
E and P were classified as Regular needy students. Students 6 and H, who had 
the lowest achievement scores of 25 and IS 1 , were selected to receive Title X 
services. / 

An achievement test was given again in the spring to the grade 3 students and 
the four Regular students still performed well with some improving slightly : 
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Table V-l 

Percentile Scores for Students in Example School* 

Grade 3 



Student Classification 


Fall 

Percentile Score 


. Spring 
Percentile Score 


X 


Regular 


. 85 


80 . : 


B 


Regular 


75 


75 


c ; 


Regular 


70 

• 


75 


D 


Regular 




65 * 




Regular Needy 


35 


25 




Regular Needy 


30 


20 


G 


Title I 


' 25 ~~~~ 


-35 


H 


Title I 


15 


25 


Class Average 




: 

50 


50 


Regular Average 




74 


74 


-\ 

Regular Needy Average ^ ^ 


32 af 


23 


Regular 6 Regular Needy Average , 

L' ~, 


60 , 


57 


Title I Average 




20 ; 


30 



and some performing somewhat less well. But the two Regular Needy students, 
£ and F, performed less well < than they did in the fall and now have the lowest 
scores of the whole class* The Title I students, G and H, profited from their 
Title I services and registered gains, gains that placed them above E and F, 
the two Regular Needy students. ? 

All of the students were promot* to the fourth grade and Table V-2 shows the. 
results for both years. At the beginning of the year the teacher v - faced, 



Table V-2 



Percentile Scone for Students In Example School* 
Grades 3 and 4 







Grade 3 






Grade 4 




Student Classification < 


Pall Per- 
centile Score * 


Spring Per- 
centile Score 


Classification 


Peurper- 

centile Score 


Spring Per- 
centile Score 


A 


Regular 


35 


80 , 


Regular 


80 


80 


B 


Regular 


75. 


75 


Regular 


75 


7* 

f 

-t 




T 


70 , 




Regular 


75 


70 


D 


Regular t 


1 • 65 


65 


Regular 


65 


60 


E 


Regular Reedy 


'35- * 


25 


Title I 


25 


30 


r - 


Regular Reedy 


30 • - 


20 


Title I 


20 


25 


G* 


Title I 


25 


35 


Regular Needy 


35 


- 35 


H 


Title I 


15 


25 

- 


Regular Needy 


25/ 

> 


25 


Class Average 




m 

50 


50 

- , L 




50 


50 


Regular Average 


74 






74 


* 


Regular Needy 


Average 




23 




30 


.1 30 


Regular a Regular Reedy Average 




57 




59 


58 


Title I Average «n 




30 


—i : — 


22 


27 
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with a difficult decision*. The Title I students, G and H, had clearly profited 
from their Title I services and were no longer the neediest students in the — ^ 
class. But if their services were taken away what would happen to their per-, 
formances? On the other hand, the two Regular Needy students, £ and F, clearly 
needed Title I Services and were now performing less well than the? Title I stu- 
dents. What to do? Facing the realities of limited funds, the two Title, I 
students had their services taken away and in the fourth grade were classified 
as Regular Needy students. 4he two formerly Regular Needy students, E and F, 
now became Title I students. The last column of Table V-2 shows the performance 
scores at the end of the fourth grade. It will be seen that the Regular stu- 
dents generally maintained their previous positions and the new Title I students 
improved relative to their previous position. The previous Title I Students, 
G and H, who became Regular Needy students in the fourth grade, maintained 
their relative position and did not fall back as a result, of losing Title I 
services. r ~ 



All of this is shown graphically in Figure V-l. Here it is important to note , 
the relative slopes of the lines. During grade 3 all groups of students 
improved their performances, but the Title I students improved at a consider- 
ably faster rate than the Regular Needy students and at a slightly faster rate 
than the Regular ?tuderits . During grade A all groups continued their improvt 
ments, with the new Title 1 students improving at a faster rate than the now 
Regular Needy students and at about the same rate as the Regular students. 
While this example is hypothetical, it corresponds reasonably well with the -* 
actual findings to be presented. In fact, Title I students do tend to 4° some- 
what better than a comparison group cosposed of Regular Needy students. Also, 
there;' is considerable change in status from one year to the next* Of those 
students receiving Title! services during a particular school year, about 1 
40 percent will not receive Title X services the next year, and those who do 
not receive them because they were 'promoted out 1 will continue to perform at 
the now-higher level that caused thai to lose Title I services* 
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fc / Figure V-l, Gains in Vertical Scale Scores fbr Buunpls School- 
/ Grades 3 and 4 (Hypothetical Data) / 
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ARE TV *. HIEVEMENT GAINS FOR TITLE I STUDENTS? /' i 

' ■ • • / 

At the time of writing this Interim Report, tj*e analysis showing the amount of 
achievement gains for Ti£le I student s^Jut^ been completed for the first year 
data. Latex, there will be a report—basedT on three years of longitudinal 
growth data, Report #10, , Student Educational Development During the School 
Year and the Effects of Compensatory Education, is In press and will be pub- 
lished in early 1981. It is a lengthy, and complete description of educational 
growth during one school year and is also a description of efforts to find 
those educational practices that lead to achievement growth; ita this Interim 
''Report only a few of the most significant highlights will 'be presenteii-since 
the results in Report #10 are guite consistent, independent of the particular 
technique used in analyzing the data, 

Tjie basic results are shown in Figures V-2,/V-3, V-4, and V-5._ The firs* "two 
figures show the -results for reading, with the fi*st figure showing theclresults 
for grades 1, 2, and 3 and the second figure showing the results for grades 
4, 5, and 6. We have chosen to use two graphs to show the results in each 
subject became it makes the presentation less complicated, (We could have_ 
shown the results for six^di^^eren^^roups of ^tudents, but the nunfcer of 
lines crossing and occupying nearly the s«aae s£ace would have confused the 
picture.) Thus, each graph shows the results for Regular students* (in Title I 
« schools), for Title I students (in these same Title I schools) and for Regular 
Ne«ady stijdents in schools not having CE. The choice of this lest group as the^ 
cptqpari^on group is somewhat arbitrary. We could have chosen Regular Needy " 
students in the Title I schools, but there are two drawbacks to using this com- 
parison group. In the first place, these students are needy, but the school 
authorities have decided that they are not as needy as those chosen fqt Title I 
services, and thus they differ from the Title I students, in the second place, 
there is the problem of the "spillover effect" which might contribute to all 
student* in Title I schools but particularly the Regular Needy students. This 
is the problem that the instruction in Title I schools may affect all th* stu- 

♦These Regular students include the Regpular Needy Students in the Title I 
schools. - — - 
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dents in ttoe school , not just the Title I students* An examination of Report 
#10 will show that the results for either comparison group lead to the same 
Conclusion. 

,»/ 

An inspection of the figures shows the results of the analysis, but such a 
presentation is not adequate for those who require statistical tests. First, 
it should be Mentioned that the backup numbers for these figures will be found 

Tables B4-1 and B4-3 of Report #10. The approximate number of students in 
each grade for Regular, Title X, and Regular Needy groups in reading are,, 
respectively, 6,400, 2,600, and 600. In math the approximate number of , stu- 
dents is 7,500, 1,500 and 1,150. The exact numbers differ from grade toTgrade. 
The larger numbers of Regular and Regular Needy students in math is caused by 
the smaller number of T Title X math students. The main point of the aboyfe is 
to stress that each data point is based on a large number of students ahd thus 
is quite stable. 

V-2 shows that for reading the Title X students in grades 1, 2, and 3 , 
at a somewhat faster rate than the comparison group of Regular Needy 
students. All groups of students had educational growth during, the school 
year. %n ea$h grade the Regular students started out a higher levels And . 
ended the school year at higher levels • In grades 1 and 2 the Regular stu«* 
dents grew at slightly faster r at e s than e ither the Title X or the Regular 
Needy * tudent^.. In the third grade the Title I students grew at slightly 
faster raters than the Regular students. In each of the' three grades the 
Title" X students grew at rates which werp higher than those of the comparison 
grotip of Regular fcfeedy students. We conclude that in reading for the first 
three grades students receiving Title I services show improvements that are 
greater tha^ would have been the case it they bad not received these Title I 
services. At the same time the amounts of improvement are, not /great enough 
to narrow the 1 achievement gap* between the Title I students and the Regular 
students'. In fact, the ga^> is becoming larger. , 



Figure V-3 shows similar data V f or reading in grades' 4, 5, and fc. For these 
•grades there dd L fcot seem to be beneficial effects from Title i services. 
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V-2. Residing Vertical Scale Scores for Title I, /Regular Needy , 
ayid Regular Students . in Grades 1, 2 and 3 
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Fi^t V-3. Reading vertical Sc*±e SC9raa for Title I, Regular needy, 
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However , the rates of growth for all three groups appear to b^^heTsama. In 
spite of this Apparently ^tjuiv^lent growth rate the gap between the Regular 
students and tae other students continues to grow* '.This growth in the achieve- 
P ment gap is sons thing of an artifact since the composition of the three groups 
keeps changing from year to year, as it must* in a cross-sectional comparison. 
The better* Title X students and better Regular Needy students keep being pro- 
moted out of the bottom groups all thfir achievement scores Improve . In any 
grade, at the beginning of any year < after the first grade), the Regular group 
is composed of the relatively high scoring Regular students plus the better , 
scoring Title 1 and Regular Needy students from the previous year . At the 
same time the ReguJ nr group loses its poorest scoring student* to the Title I 
and Regular Needy groups, who have in turn lost theiof better students and had 
tfcem replaced by poorer scoring students. Thus, it is almost inevitable that 
\ in cross- sectional data the gap between Regular and; Title I or Regular Needy 
students appears to wid*n as grade increases. Another contributing factor ii 
that the absolute number ot title X students decreases as grade increasei 

with the result that the avkrage achievement level of Title I studentp in the 

— ^ ' • 

higher grades is lower relative to that in the earlier grades. This is true 

because the most needy students are being selected and since fewer are selected 

| in' the higher grades they are relatively lower scoring. Xn summary, for read- 

/ ing Title X seems to be somewhat effiet±v# in grades 1, 2, and 3, but not 

effective in grades 4, 5, and 6. 
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Pigures V*4 and V-s shop the results for math. The result s\here are more 
f positive than they a^e for reading. They show that for all grades the Title X 
students improve at/ a faster rate than the. Ri^ular Needy students. .Further- 
more, the Title X students in math improve at faster rates than the Regular 
Students while the Regular Needy students change at 'slower rates than the 

• Regular students • It seems quite clear that Title X is effective in math and 

/ 

considerably more so than in reading. J 

An explanation for this ma** be the difference in the way reading and math are 
learned by students. Reading is learned in school but also in a number of 
other settings. There are opportunities to learn reading at home from many 




Figure V-5* Math Vertical Scale Scores for Title I, Regular Needy, 
I and Regular Students in Grades 4, 5 and 6 
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sources, such as comic books, regular books ,C newspapers , instructions on toys 
and packages, and also away from home on posters, advertisements, in Sunday 
School and in other social settings. On the other hand, the ^opportunity to 
learn math is much more limited. Outside the school there is some opportunity 
to leaurn math in changing money, ~n sports in keeping score, etc. but such 
math is quite simple and generally does not increase in complexity with the 
increasing age of the student. Thus, the school is the main place where ifiath 
is learned, and it seen apparent that the additional services provided by 
Title I to math students result in increasing their levels of achievement. 



The four figures showing graphs of achievement change give the basic results, 
but the technical reader will want to refer to Report #10 for the detailed 
statistical analysis. In describing the methods used in analyzing the data, 
Ming-mei Wang, the author of Report #10 says: 

"Five types, of evaluation models- are employed that are related to 
.'the models required by the Education D*£>artment for use by grantees 
in evaluating and reporting on their local Title I projects 
(45 era, Parte 116 and 116a.) The, large SES samples provide us 
a unique opportunity to apply a variety of methods that require 
different subsets of data po address the same question. Briefly, 
the norm-referenced analyses are variations of Model A (norm- 
referenced design). The analyses of variance (ANCVA) with dif- 
ferent layouts and different measures of growth, and the analyses 
of cover iance (AHCOVA) .using different analysis groups and ad- t 
justed for unreliabilities of the covax^ate (pretest score) art 
designed to address the cases of Model B ( control-group design) • 
TUe comparison of gains conditional on pretest scores is a devia- 
tion of Model C (special regression d>si^n j t Additionally, the 
comparisons with expected growth represent a blend of Models B 
and c where r egres sion-based prediction models are employed to 
mimic the performance of a control group that is like the treat- 
ment group in pretest scores and othejf relevant characteristics. 
The analysis at each design further ^encompasses a class of sub- , 
analyses. All the analyses are devised to coeplement one another 
so that pitfalls in one may be avoided in another. In the end, 
we hope that the integrated findings from these different 
approaches will approximate an accurate evaluation. M x 



The different analyses mentioned above were carried out arid are contained in 
Report #10.. They essentially confirm one another and indicate the statistical 
-soundness of the conclusions previously stated, namely that Title X does have 
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a positive effect for reading in the 1st, 2nd, and 3rd grades and in all 
grades for math. * 

WHAT EDUCATIONAL PRACTICES ARE ASSOCIATED WITH TITLE I EFFECTIVENESS? 

We have shown that Title I is effective in increasing the performance of lofr- 
achieving students. We would like to tiq able to show that certain educational 
practices, principal and teacher characteristics, and methods of classroom 
organization are related to this Effectiveness, so that the useful ones could 
be more widely adopted. Therefore, we explored a number of these variables. 
We investigated the relationship of the following tq increased achievement: 

• Instructional services such as the number of hours of instruc- 
tion and the costs of that instruction. ftlso, such factors as 
the amount of instruction received from regular instructors, 
special -instructors, tutors, or through individual instructional 
materials . 

• Student background variables such as economic status, white/ 
minority status,' and mother's education. 

• The type of school and instructional settim, That is, whether 
the school was a Title I school, an Other CE school, or a non- 
CE school. Also, whether ^the instruction was given in the 

u 

-I- 

whole classroofn setting, in small groups, or through individual 
" instruction. 

• Characteristics of the instructional personnel such as years 
of teaching experience, amount of college training, amount of 
in-service training, and attitude -oward the school program. 

• Characteristics of the educational environment such as the 
school's minority concentration, school's CE concentration, 
district's control of instruction, principal's instructional 
leadership, amount of classroom disturbances, etc. 
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• Characteristics of educational practices such as: the, amount 
of effort devoted to planning and evaluation, use of lesson 
plahs, frequency of feedback, amount ,6f homework, individuali- 
zation of instruction, and use of audiovisual aids. 

The possibler ef f ectivenesa of these variables was explored by a number of 
different techniques such as regression analysis and causal modeling! > Gen- 
erally the results were disappointing in the sense t^hat there were no strong : 
relationships between any of these variables and increases in achievement. 1 
There were some relationships that seemed to be significant but they were not 1 
strong. The most noteworthy findings were: 

• Greater experience in teaching is related to higher student 
growth in both reading and/ math. 

• The amount of regular instruction and tutor/ independent work 
shows some positive, but modest, effect* on achie vem e n t growth. 
In contrast, amount of instruction by special teachers or in 
very small groups does not often contribute to thp explanation ^ 
of achievement growth, and when it does, a negative relation- 
ship is observed; 

• In both reading and math, disruption of instruction tends to 
be an unfavorable condition for learning in the upper grades : 
but not in the earlier grades. 

• Frequency of feedback on a student's progress sometimes, re- 
lates positively to reading and math achievement growth. 

e In reading only, a teacher* i effort in planning and evaluation 
shows a positive relationship to achievement growth* in some 
grades. f \ 

In ■ miii 1 1 In j this chapter it can be said that there is evidence that Title I 
services are positively ^^ilat^d *o achievement growth in reading in the first 
three grades and that Title I services are positively related tp; achievement 
growth in math in ail grades! XTTW^ iscuase^ th^' are rym Educational 
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practices that are positively ^related to achievement gro%*th. I Particularly 
noteworthy is the fact/ that students 'who receive instruction from more ex- 
perienced teachers prbfit more than 'those receiving instruction from less 
experienced teachers^ Also, instruction in the regular classroom setting seems 
to be a positive factor as does receiving, instruction in a setting without 
disruption. ^T^— _LL_ C * * 

From a practical point of view, the implications of these findings are that 
Title I services should be increased so that they are available to all needy 
students. Since only about half of all needy students are how receiving: Title X 
services this would require a Very large increase in the amount of Title I fund- 
ing. A political judgment is required as to whether the amount of gain i3 
Sufficient to -justify this increased funding, but it is clear thr" . .very large 
( nunfbgr of children who could, profit from Title I services is not receiving 
them. *£ 6 - ' 



The findings also/suggest that educationally needy students should be the bne& 

to receive instruction . from the most experienced teachers in a regular class- 

. ; - T 

room setting. At present this tends not to be the case. Title I students 

tend to receive their instruction from less experienced teachers and not in • 

the regular classroom. These are matters that could be corrected at the local 

, » . /< 
district and school level. 1 - 

These findings are based on the analysis of the first year data. We are how 
analyzing the data from three longitudinal years. When these analyses we ; 
finished we will be able to rdfine and expand the results reported in this ' 
chapter* ; { 
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CHAPTER VI . HOW COST-EFFECTIVE IS COMPENSATORY EDUCATION? 
Swpnary , i 

In CE programs it ie~ usually assumed that as the cost of the re r 
sources increases, there willi be a corresponding increase in, the 
^growth of student achievement. This assumption is baeie to most 
federal education programs. To test this assunpHpn, a "resource- 
cost" model was developed that allowed us to examine the relation- 
ship between instructional costs and achievement growth. The re- 
sults were that: , * ^ — — ~~ ~~ 

0 THere is no Remonstrated relationship between the 
costs of the instruction ^tudents receive and changes 
in academic achievement . t 

- It has consequently been arguecfc that this finding can be explained 
by the fact that the least able students receive the most gostly 
services, and they are also the ones that are least tikelg to 
improve academically. This idea was tested and it ixts found 

» that: ~ 

• The cost of instructional services received by the 
least able students is higher than the cost of in- 
struction for more able students. 

? , f • 

While this?' finding offers some explanation for the lack of re- 
lation between instructional cost and achievement growth, it. is 
f not a, sufficient explanation. : In view of the importance of these* 
findings, it is suggested that an independent analysis of our re- 
source-dost data be unde&aken to confirm the results, or to 

A 

develop a more appropriate methodology. 



INTRODUCTION ( \ 



It seems reasonable that as more and mprte jCB*ottrccs -*r« ffiacTe available for the 
instruction of J.a*- J a^ij&rt^™st\ydentB, the achievement of the students should 
increase. One of the assumptions underlying federal funding of educational 
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program is that poor school districts are not able po marshal! enough local 
resources to provide the extra services that should help low-achieving stu- 
dents to improve their performances. We attempted to test this broad assump- 
tion by investigating the relationship between the amount and costs of re- f 
sources consumed and consequent changes in student achievement. The finding 
is that there is no positive relationship between the total cost of the person- 

y * , ■ \ ' - ■ - 7 

nel add other resources used in instruction and growth £n achievement. Since 
this finding is contrary to conventional wisdom, as weii as the assumption under- 
lying Title I and many other* social programs, it deserves to bet scrutinised 
caireful ly r 

THE RESOtlRCE-COST MODEL 



Early Studies of costref fectiveness were usually baked on obtaining the total 
expenditures involved in a CE program and dividing them by the number of par- 
ticipating students. This gives a pe$-pupil coat, but therm are many reasons 

v ** ' • * 

why this approach gives untrustworthy results. Report #7 discusses these 

reasons, which includes the assumption thkt all students in a project receive 
the same services, the vastly different amounts of money that actually are 
used for instructional purposes even though the per-pupil expenditures are 
the same (due to different amounts that are taken 'off*the~tqp' for such - 



things as administration, building use, capital expenditures, and staff ti*in~ 

£ - • - 

ing) , and variations" in costs f cor similar services between different regions 

r the country. * 

have recently developed a "resource-co#t" model based on tt$i idea of applying 
a standard cost t^ngadt «ervice--«ctuaUy received by. students. This bottom- 
up approach, as contrasted with the top-down .approach, starts wiih a teacher 1 s 
report of how much instruction each student received. The teacher indicates 
for each student the amount of reading instruction (or math instruction) re- 
ceived, and the situation or context in which the instruction was given; that 
is, whether the instruction was given in jthejrhola classroom by the regular 
teacher | in fl inal * gaeuj fij f Tt^'ti 1 teacher, in a small group by an aide,* 



140 



158 



or in some other instructional setting. The teacher also reports the in- 
structional materials and equipment usedf 

,f* * 
r 

Standard prices were developed for each element of instruction given under the 
various conditions described above. These prices aire uniform for ,all students 
under similar conditions and thus ignore actual variations in teacher salaries 
fro* one region of the country to another. The basic assumption 'is that a 
teacher with a certain amount of education and teaching experience is doing 
as. effective a job in one job location a^s Xn another. Likewise, it -is assumed 
that similar instructional materials and equipment have the same effectiveness, 
* irrespective of their actual cos*. Thus, by using this 1tfpe-ot thinking, for- 
mulated in a resource-cost model" a uniform, common metric was developed and 
used to cost the instruction receiv^4-by>acl^tudent. (This metric did hot 
include administrative costs, building "costsT^an^^Qier overhead tim^, which, 
while real, were believed not to have a direct impact on instruction.) The 
resource-cost model is described in detail in Reports #6 and #7, which also 
cite relevant literature regarding the model and alternative methods of mea- 
suring cost-effectiveness". 

. THE RELATIONSHIP BETWEEN INSTRUCTIONAL COSTS AND STUDENT ACHIEVEMENT GROWTH 

* - 
FigUre VI- 1 shows the relationship between reading program costs and student 

achievement growth* for Title I students, and Figure VI -2 shows this relation- 
ship for educationally needy students in non-CE schools* Overall, the results 
show that th^re is no significant positive relationship between these two 
variables. y Tor some grades there, seems to be a slight positive relationship 
but it is countered by other grades with slight negative relationships. In 
Report 17, detailed statistical tests are reported and tW6V$rall conclusion 
is that there are few statistically significant trep*f l and, whel^ they are 
significant, they tend to be negative. , (This^rtSg^tiVe cor relation ^flle^ns that 
thn enrs qnntt^ft||| Mmvirrrrn iiMlffTTnTrnrnf wn the less the achievement g 
made by the student.) The authors of Report #7 says 



*The figures show percentage gain in student achievement during the school 
year: percentage gain equals raw gain divided by the pretest score times 100. 
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*Our results have been* npndecisive in the sense that nonS 'of our 
comparisons among groups of students reveal meaningful differences 
inmost-effectiveness. On the other hand, we are not quite pre- 
paid to conclude xhat the level of resot^rce utilization has no 
independent effect! on put com*. Though stall , the raw regression 
coefficient* that served as our indices tof cost-effectiveness * 
fr equentl y exceeded two jpid three tines their standard errors 
and were often disturbingly negative. 



Taking these result at face value, one might conclude that in- 
creased utilization of resource* has a nuisance effect that tends 
to diminish achievement across test of the range of program cost 
that we observed in our sample. If this were truly the case, we 
might be able td find a critical cpst bel£w which the returns to' 
cost are increasing, and above which their are decreasing, lie 
believe such critic al points should have' been revealed, by our 
models that specified cost Jji both first and second order terms, 
but the evidence <wms, not decisive one way or the 'other." 



•1 



It can also be argued that the reason for the slightly negative relationships 
is due to the fact that more, resources "ire given to" the more needy students. 
It is argued that the most needy students will have more difficulty in improv- 
ing their, levels of achievement than less needy students and , thus" the negative 
relationship found is determined by the nature of the students receiving the 
more costly services rather than the ineffectiveness oft the increase il* ser- 
vices* Figures VX-3 and VI -4 show the relationship between fall reading 
achi evemen t scores and the cost of reading services received by thfe students, 
it will be seen that pm jlower-achieving students do receive more costly .ser- 
vices than higher-achieviig students. While, the relationships aire not strong * 
they are, at least large enough to support the idea that phm negative relation- 
ship between coet a^fachievemei^ i* a function of the achievement devel ,of ° 



9^" 




fig served. 



The* authors of Report #7 say?" 
*** •» ** n , 

the same reasoning obtains here as in the area of health 
care* That is, grieyiously ill patients consume Wre costly > 
and intensive medical care; yet the, returns to such medical 
care, am measured in success rates, (cures) 1 , are probably lower 
than those encountered with less seriously ill patients who re- 
ceive less costly or intensive treatment. In effect, then, the 
same non-equivalence among treatment groups exists in terms of 
allocating services. * 
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Figure VI- 3. Fall Reading Vertical Scale Scores and P.rograjn 

Costs by Grade— Title I Students / 
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Figure VI- 4. Fall Reading Vertical Scale Scores aiKl^Program Costa by 
Grade— Educationally Reedy Students in Non-CE Schools 
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While it is possible to offer explanations for the negative relationship, it 
is still important to ask why a fairly strong positive relationship wad not 
found in groups of students homogeneous in achievement level. The idea that 
increasing the fundi- g, and thus services to needy students, will lead to 
increased achievement is so pervasive and fundamental to federally- funded pro- 
grams that these findings must be most carefully examined for faulty analysis. 
One way of checking the possibility that the results are due to a :lty 
resource-cost model is to undertake the same .analyses using total hours of 
instruction received by the student (instead of estimates of costs of the re- 
sour ces^oevOTed-^^thip" instruct ion^^JKie^osl^oFlio^^ of instruction received 
is independgnfe-of^any^cost madel^ and in a sense is more basic thar a cost- 
effectiw .. as analysis. Yet the results are the same as those found with the 
resource-cost model . The authors say : - 

'"We are confident that our cost metric is not at fault. For ex- 
ample one might question their use in models with a single cost 
variable, since this assumes equal returns irrespective of the 
ways in which resources are deployed. We believe we have addressed 
this question in the analyses where ' ie data are blocked by pro- 
gram configuration, and total cc^t i; disaggregated into ten pro- 
gram component costs. Another possibility in that the utilization 
of resources has beneficial effects, but the benefits do not advance 
as jrapidly as do the costs. We have addressed that question by 
substituting program component hours for program component costs 
in some of our trials; we still obtained negative regression co- 
efficients for the individualized-instruction components and the 
special-teacher-instruction components. Therefore, the cause for 
the negative relationships £s Jiot in the cost mettic alone." 

The resource-cost model used has been cifltticized by some researchers as faulty. 
They say that th* model does not take into consideration local economies that 
astute school superintendents may be able to achieve, and that it also inproperly 
lumps together regional variations in costs. In our view these criticisms are 
irrelevant to the study of cost-effectiveness on a national level. Neverthe- 
less, the importance of the relationship between the costs of services received 
and gains in achievement is such that we recommend that an independent analysis 
of the SES cost-effectiveness data be undertaken. It may be that there are 
some underlying logical flaws in the way the analysis was done, although we 
doubt this to be the case since the methodology was developed at one of the 



most prestigic -s organizations in the cost-benefits analysis fj^eld. r ut is 
possible that an overall analysis in which all students are lumped together 
may mask relationships that would be found at the individual school level. 
When we have the results from our in-depth study of 55 high-poveyty schools we 
will have more information on this subject. But based on the present results 
we believe an independent analysis would be worthwhile either to confirm the 
results reported here or to clarify the methodological problems ift such analy- 
ses. 

/ - 
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CHAPTER VI Jv WHAT HAPPENS TO THE ACHIEVEMENT OF STUpENTS WHEN THEIR 
COMPENSATORY EDUCATION SERVICES ARE DISCp^TiN^ED? 

Surrtnary ~ _ ^ ^ ^ v \ 

\ 

'"his chapter examines the frequency of termination of CE services 
and the change in achievement growth that results when CE services 
are terminated. The results show that: 



0^ There is considerable turnover j rom yegr^o^geo^ among 
the students receiving CE^ervice^T^ About 4C percent 
of the students j^e&ertSvngTitle I in a given y&ar will 
not be receiving it in the following year* The turn- 
over isnigher in other GE programs. 



0 There are three reasons for this turnover. About 60 
percent of the CE students who are discontinued are 
'promoted out 9 because their achievement increased 
enough to 1 no longer place them a >g the most needy ; 
IS percent were promoted to grades which no longer 
had CE services, and 2$ percent were in schools that 
lost CE funding in the second year (but this was not 
common for Title I students). 

0 When the instructional services received by the stu- 
dents who had, lost CE were examined, it was found 
that the services of these former CE students had 
reverted to the same services as received by Regular 
students. 

0 During the year when CE services had been discontinued, 
the students who had been 'promoted out 9 continued to 
perform at higher levels arid did not seem to revert 
to lower achievement levels. 
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INTRODUCTION , 

The discontinuation of CE services became, an important educational issue when it 
was reported (GAO, 1975) that districts and schools differently interpreted the 
Title I requirement to serve the most educationally deprived students. Under one 
interpretation , as lorn; as the student is among the educationally deprived when — - 
entering the program, that student ij^ taJ>fi--r*taM an age- 

appropriate achievement level. Under another interpretation, a student has to 
r^ in among the most educationally deprived to be retained in the program; 
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otherwise, the Student, is replaced by a student who is more educationally de- 
prived. Under a third interpretation a student is retained in the program even 
after reaching an age-appropriate level, in the belief that the extension of 
services is necassax^r to maintain achievement growth. Based on these GAO find- 
ings and on recommendations from states, districts, and the USOE, bearing both 
on student needs for stable programs and institutional needs for educationally 
sound guidelines, Congress clarified the ^ la^-fMuwtion Amendments of 1978). 
The amended law^^aeiaes 1 -^^^^ I funds must be used to meet the needs of 
students in greatest educational need, but it provides an exemption (among sev- 
eral) for students who were determined to be in greatest need in a previous year 
but no longer are, even though they are still educationally deprived. In effect, 
the amendment allows schools and districts to maintain Title I services for stu- 
dents who qualified in *he previous jear, so that students are not caught in a 
"revolving door" of alternating receipt^awTdisi^ 



But the GAO findings were based on less than representative data and the recom- 
mendations from other sources tended to be based on impressions and anecdotal 
exasples. In th* Sustaining Effects Study it was possible to study the problem 
in detail and determine whether or not it was a serious problem. Three questions 
were studied: 

1. What is the incidence of the discontinuation of CE services? 

2. What educational services do students receive after their CE services 
are discontinued? 

3. What happens to the achievement 1- .Is of students when their CE ser- 
vices are discontinued?. 

Data were available for the 1976-7 ' and the 1977-78 school years. Data from the 
1977-78 school year were more reliable because we had positive records of each 
4,^— ant's status in the previous school year. For the 1976-77 school year the N 
students 1 statuses were reported as teachers remembered them and were thus subject 
to some error. The two data bases were analysed separately and tend to support 
each other. Therefore, only the results from the 1977-78 school year will be 
reported here and are given in detail in Report #11. 
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WHAT IS THE INCIDENCE OP THE DISCONTINUATION OF CE SERVICES? 

Three reasons for the discontinuation of CE services were available for study: — 
first, discontinuation because the student had reached an achievement level that 
no longer qualified the student for CE services; second, discontinuation because 
_a CE student was promoted to a grade which did not have CE services; and third, 
the^ituctent was in a school during the second year that lost funding in the 
second /ear even though it had funding in the previous year. About 60 percent 
of the students no longer receiving CE services had them discontinued because 
they w*re no longer qualified due to high achievement; 15 percent were no longer 
selected for CE because they were promoted co grades in which there was no CE 
program, and 25 percent were discontinued from CE because their schools lost CE 
funding (although this was not common for Title I students) . 

-There are two ways of looking at the data. On the one hand we can ask what 
percentage of all the students in the school have their services discontinued; 



on th^other £and we can be concerned about the percentage of students in 
ticular CE p^ograin^who Jia»e_aeryices stopped. Table VTI-1 siiows-th^clata both 
ways. When viewed from the perspective^of-alL-. the stu dents in the school, the 
problem does not seem particularly large. Depending on the CE program involved 
and the subject matter, the percentages vary, but about 5 percent of all the 
students have CE programs discontinued. The more important figures are the pro- 
portion of CE students who have CE services discontinued. For Title I about 40 
percent of the students receiving Title I services in one year will not receive 
Title I serv* as the next year. For both other federal programs and state/local 
programs, the turnover is considerably larger than in the Title I program. For 
Title .he students losfng Title I services are mostly students who no longer 
qualify because their academic achievements place them above other more needy 
students. For the other fed* il and the state/local programs there is 4 much 
stroiger tendency for the schools to lose funding or to have the students^pijo- 
noted to a grade without that category of funding. 
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Table VII-1 



Percent* j« of Students {those CE Was Discontinued, by Reason 
for Discontinuation, CE Funding Source, and Subject Natter 



Title I 



Poxmi Title Z students no longer 
qualified 

Former Title Z students but school 
lost funding 

Former Title Z students but pro- 
moted to non-Title Z grade 

Title X students in both Year 1 
and Tear 2 

ftew Title z students in Year 2 

Wot Title X students in either 
Year 1 or Year 2 



Other Federal CE 



Former Other Federal CE students 
no longer qualified 

Former Other Federal CE students 
but school lost funding 

Former Other Federal CE students . 
but pnpeoted to grade without 
Otter Federal funds 

Other Federal CE students in both 
Year 1 and Year 2 

ffev Other Federal CE students in Year 2 

Mot Other Federal CE students in either 
Year 1 or Year 2 



% of All Students 
Heading Math 



% of Title Z 
Students in Year 1 



6 

0 

1 

12 
10 

72 



4 

1 

0 

7 
8 

80 



K> tiling 

34 

0 
5 
61 



Math 

32 

7 

4 
57 



% of Othr FtJaral 



% of All Studnf 



N l 

\ 

2 \ 



i 

2 



CE Studonf in Y— r 1 



21 
41 

20 

19 



22 
33 
25 



93 



96 



170 
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(Table VII-1 Cont'd) 







& ill 

* or aii 


C ^ + * A y% ^ m ** 

btuuents 


"s of State/Local 

CE Students in Year 1 






Former State/LosaJ. CE students no 












1 


longer qualified - — 

r oiMr dvate/ juoc*.! v£ students out 
school lost ^fwding 


2 

4 


2 


21 ~ ~ 
36 


18 

32 






Foxier State/Local CE students but 
promoted to class without State/local 
funds 


1 


1 


7 


16 






State/Local CE students in both Year 1 
and Year 2 


4 


2 


35 


34 






New State/Local CE students in Year 2 


7 


6 








i 


Hot State/Local CE students in Year 1 
or Year 2 


83 












Table VII- 1 clearly demonstrates ^that there is considerable turnover among CE 
students. But is there evidence that there really is a difference in achieve- 
ment levels between^£hose whose CE is discontinued and those who continue in the 
CE programmable VI I- 2 shows the average Comprehensive' Tests of Basic Skills 
aehi^v^aent percentiles for the different students in terms of their statuses in 
if ear 2. The CTBS scores are for the spring of the first year because that peri-° 
od represents the time when achievement information would be available for de- . 
cisions about assignment to the ensuing year's classes. The table shows that 
the regular students are slightly above the mean in achievement while all cate- 
gories of previous and present CE students are considerably below the mean. 
Students who have had their CE services discontinued for one reason or another 
fall considerably below the regular students but considerably above those who 
continue in the CE programs from the previous year. Those continuing in the 
program have achievement means in the 25th percentile range, while tnose whose 
services-have been discontinued tend to be in the 35th percentile range. Thus 
it is apparent that those whose CE is discontinued are those who are performing 
relatively well and that tiiose who are retained in thejpira$raiu are still per- * 
forming poorly. These figures indicate tha t CE acted ni s tra tors are behaving 
appropriately in deciding which students to retain in the program and which ones 
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Table VII- 2 



Average CTBS Percentile Scores Over All Grades by Transition Category 
(Percentile Scores for Spring of Year 1, Transition categories for Year 2) 



\ 



Transition Category Mean CTBS Percentiles 

Beading Math 

Borpil arjrtrtents > — 55 51 

^^^^ 

Discontinued txam CE in Year 2s ^ 
Due to high achievement 

ytlon to oo p ^ CE 




Because school lost funding 

CE Stodsntst - . 

Continuing in progran fro* Tonr 1 23 26 

Starts CI in Taar 2 32 33 



to 'proMote out.' At tha mm tiaa wr should not forgot that those who ware 
'pronotsd out* wara not doing as veil as tha rsgulsr stqdants. 

Clearly for CE students there is a large turnover, with many students receiving 
CE services in one year and then having then discontinued the next year* Hon 
serious is tats? One way of looking at it is to say that it is not serious at 
all* If in the second year the student is clearly not as needy as other stu- 
dents, then the other students shouM receive the services and, with United ' 
funds , the less, educationally needy s talent should be dropped fro* the program. 
But, if in th# process the student whose services were discontinued drops 8*pk 
and ag&Ln joiW the aost needy ranks r then a 4isservice has been done the student 
aM have ^revolving-door process in whicfc ^a student is successful he is 
re*»v*d f rosi the program oid^to fall back because the services have been wit2i- 
tirmm. But this i*-enly a conceptual problem; what really happens to students 
who have been proseted out because they no longer qualify? 
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EDUCATIONAL SERVICES AFTER TERMINATION OF CE 

0 

The regulations for Title I, by far the largest of the CE programs, specify 
that CE services are to supplement rather than supplant regular instruction. 
Because the number of hours in the school day is usually not increased for CE 
students, *the CE program usually consists of different instruction which is of 
greater intensity or higher quality than that for regular students, as we noted 
in Chapter IV. Or the CE program may emphasize instruction in reading and ma th- 
at the expense of other subjects being taught to the regular students. When a 
student's CE services are discontinued, we would exp'ect that the hours and costs 
of reading and math instruction would revert to approximately that of regular 
students. Is this actually the case? 

Table VII-3 shows the hours and Costs of reading and math instruction averaged 
over all grades by student category. Hie table shows that the number of hours 
and costs of instruction for continuing CE students are considerably higher than 
they are for regular students. The corresponding figures for students whose CE 
has been terminated are quite close to those for the regular students. There are 
wide variations in the services offered from grade to grade , in reading, however, 

* Table VII-3 

Average Hours and Costs of Instruction by Student Transition Category 



Transition Category t 


Reading 






Math 




Hours 


Cost* 


Hours 


Cost* 


tegular students 


239 


25C L 


175 


135 


Discontinued from CE in Yeir 2: 










Due to high achievement 


246 


280 


174 


151 


Due to promotion to non-CE grade 


225 


266 


169 ' 


144 ' 


Because school lost funding 


244 


288 


171 


154 


Continuing CE students 


258 


426 

* 


206 


305 



•Standard resource dollars 



| 155 

173 ' . 



so the average figures do not give the whole picture. Figure VII- 1 shows the 
cross-sectional costs of instruction by grade. Again, we see for reading the 
marked decrease in the cost of reading instruction as grade increases, and we 
also see the ouch higher costs of the reading services offered to CE students. 
There seen to be a slight tendency for discontinued students to receive more 
costly services than regular students, but they are cjtearly differentiated from 
the continuing CE student*. A similar figure for math would show the same pic- 
ture as that for reading, e^ept that oath instruction costs are relatively con- 
stent across grades. From this Material it is clear that when students are ter- 
minated from CE they really do stop receiving the services they would have been 
receiving if their CE statue had not changed. When one looks at the nature of 
this change, it becomes apparent that the discontinued students are getting 7 
their instruction from regular teachers gather than from special teachers in 
small groups. This may not necessarily be bad. He have already seen that reg- 
ular teachers tend to be associated with superior instructional results. What 
in fact happens to the discontinued students? Do their achievement levels drop 
as a, result of the lack of more costly and intensive services? 

ACHIEVEMENT AFTER TERMINATION OF CE 

♦ 

We now know that there are many students who are terminated from CE programs for 
a number of reasons, but high cm the list, is termination because they are achiey- 
ing at a level that is relatively high. We also know that ^ if a CE student is 
terminated, then the new instructional program takes on the characteristics of 
the program for regular students in contrast to the more costly program offered 
to CE students. The question now is whether the t erm i n at e d CE students retain 
their relatively high levels of achievement or whether they revert to previous 
lower levels. There are two ways of looking at this question. One way is to 
determine the relative achievement status of the students at the end of the next 
instructional, year to see if they still are achieving at relatively high levels. ' 
The other way of addressing the question is to look at rates of growth during 
the subpequei^t school year to see if they remain at the levels they were while 
the students >w**a receiving CE. Both approaches will be examined. Table VZI-4 
gives the percentile achievement levels for students in the ^pring of the second 
year. This table is for Title I students. Similar data are available for other 



156 

174 



\ Table VII-4 

Average-Reading arid Math Percentiles for Spring of 

the Year After CE Students Were Discontinued 



Category 

2 



Grade 



Reading 

Hegular students 61 63 65 60 58 

Continuing Title I students 24 26 17 20 17 

Students Discontinued froa Title Is 

Due to high achievement 26 42 37 28 30 



Due to promotion to class 

without Titla I 41 , 34 30 32 36 



\ 



Because school lost funding 



^ ***** 

Regular students — — 59 59 56 5* 58 

Ctetinulng Title X students 33 23 25 22 31 

Students Discontinued from Title Is 

Due to high achievement " 41 41 37 33 35 



h Due to p ro mo ti on to class 

without Title I 48 48 30 22 24 

Because school lost funding / 39 45 30 38 36 



l 

federal programs and for state/local programs, and the interested reader can 
refer to SSS Report #11 where it will be seen that the results are similar to 
those for Title . The table shows, for both reading and math, that the regular 
students are a sieving in the spring 1 of the second year at levels considerably / 
above the average* those Title I students whose CE program continued during 

the second year are still performing at quite low levels. However, those students, 

i 

V 

158 

: 176 



who had been Title I students^ a^T whose services were discontinued due to their 
higher achievement continued to 'perforin at levels which, while not equal to the, 
'regular 1 students, aire much higher than for thosfe students who continued in* / 
Title I. it certainly appears th^t^those students who had their services dis 
contijsa^ did not drop back to the general level of Title I students. 

The second way of examining the question of whether the. discontinued students 

have continued to grow at rates similar to rates while they wgre CE stud/nts 

is to e xamine growth curves. The general idea is to determine the rate of growth 

Of the student during the year in which the student received CE and then to corf- 9 

pare that^ growth fate with the growth rate in the next year when .the student did 

' it - — 

not receive C5. This is a: somewhat complex and inexact comparison due to several 

factors. .rst, we know that the measured rate of growth decreases for each suc- 
cessively higher grade and thus the second year's growth should be somewhat less" 
than the first year's rate. A way to get around this difficulty is to form com- 
parison groups aid see if th# growth of those whose CE services were discontinued 
is sirtdlar to the growth of those whose services were continued (or a similar com- 
parison can be made with regular students) . The problems wfth this method are 
that students of different achievement levels grow at different rates , and regr 
sion- to- the-mean effects are different, depending on achievement level. While 
bearing t^se problems in mind, we attempted to compare growth rates. Hie gener 
method is to determine the growth that took place in the first year and from that 
growth to predict the growth that should take place in the second year. Then the 
actual growth in the second year* is compared with the predicted growth in the 
second year. The- difference betwe^ the predicted growth and the actual growth 
is called the difference score, if th$ student 3 rew more than was predicted then 
there is a positive difference score, and if the student grew less than predicted 
there is a negative difference .scorJe. r 

Table VII- 5 shows the difference scores during* the second year for students who 
had been Title I students in Year 1 but those services' were discontinued in Year 2. 
Similar scores are shown for regular students, and for students who received 
Title I services in ]f>oth Yeap 1 and Year 2, (Similar results were obtained for 
the other funding categories and can be examined in Report #11.) Regular student* 
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Table VII-5 

Average Difference Scores in Reading and Math for Year 2 
(Vertical Scale Scores) 



1 


• 




Grade 




9 


2 


3 


4 


e 


6 




Reading 










Regular students 


-22 


-6 


-14 




0 


^Continuing Title I students 


6 


4 


18 


Jy 


12 


Students whose Title X was 
discontinued 


* -6 

* * 
Math 


-2 


0 




1 


—gu lay/ students 


-12 


-17 


-14 


-16 


-9 


Continuing Title I students* 


• 9 


9 


9 


4 


6 


Students whose Title I was 
discontinued 


• 27 


11 


iio 


-4 





tended to have actual scores which were below thoae pr$4icted from the first 
year growth experience. This is what we would exp^t^fsom the fact that actual 
growth rates are soaawhat lower in each successive grade/ The growth rates for 
the students who ipeeived^ntle I services in both Year" 1 and Yfcar 2 .are positive* 
while tfcLs positive growth is encouraging and consisteht with the general finding 
that Title I has a jtositive effect, the conclusions need to be teapered by rem*- 
bering that these students com fro* the lower part of the achievement distribu- 
tion and will exhibit higher regression effects than the other two groups.' Fi- 
nally, the students who had their Title I services discontinued in- the second 
year fall between the re|^lar students and those who continued to receive Title X 
services* In Year 2 the rate of reading achievement for these discontinued stu- 
dents didn't quite keep up with their growth rate* during Year 1 wbe» they were 
receiving Title I services. In math, th# previous Title I students seem to sur- 
pass Ntheir expected Year 2 growth when thev are in grades 2, 3, and 4, but net* 
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to exceed expectations in grades 5 and 6, (in interpreting these figures we 
must remember that they are expressed in vertical scale scores and not percen- 
tiles. Generally, a gain of about six vertical scale scores is required to be 
significant at the .05 level.) ~~ 

The conclusion drawn frogn this material is that those students who have had their 
Title I services discontinued continue to grow in the next year at about the rate 
that would be expected if they had continued tp receive Title I services. The 
data supporting this conclusion are not as clear as would be desirable because 
they are^^ohtaminated by the fact that comparison groups come from different 
levels in the achievement distribution and thus grow at different rates, and 
also by the problem of differential regression rates* However, when we consider 
the results based on growth rates and the results based on the percentile scores 
achieved in the sp ring of the second year, we f ee l safe in con c luding that the 
discontinuation of CE services for the higher of the low-achieving G? students 
do- 3 not result in am impairment of their achievement growth in the subsequent 
school year. 
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CHAPTER VIII. WHAT HAPPENS TO STUDENT ACHIEVEMENT OVER 
THE SUMMER, AND IS SUMMER SCHOOL EFFECTIVE? 



SuMrtovy 




This chapter examines two questions. The first cor ^^ns the 
amount of achievement *oss or gain over, the summer. The second 
bears on the effectiveness of summer school. The results are: 

0 There is no absolute loss over the summer* There 
are quite large reading gains qver the summer and 
there art smaller math gains* 

0 In comparing Ct students with regular students^ 
there may be a very slight^ overall relatively^ 
^smaller sumer gain for CE students in reading* but 
not in math. The differences are so small thai 
they have no practical significance* 

0 The relative changes of high achievers and high 
gainers were examined* The results are compounded 
by regression effects and show that high gainers 
tend to lose over the summer but low gainers tr*d 
to gain over the summer. Such changes as may exist 
do not seem to justify any special siamer programs. * ^ 

0 In comparing the achievement gains of students who 
attended sterner school with those who did not attend* 
no differences were foun<? It is emphasized that there 
is relatively little instruction in reading or math 
during sumer school and that gains probably should 
not be expected. 



INTRODUCTION 

All groups of students show achievement growth durin. regular school year. 
But what happens to thaf growth over the summer? To what extent do students 
continue to grow academically even though they receive no formal instruction? 
We have already seen in Chapter V that during the regular school year the rate 
of growth for CF students is sometimes less than it is for regular students. 
It has been suggested that during the summer, regular students continue to 
improve t heir achievem ents due to informa l laming ^por-ignegs, but thatr~€£ 
students lack both the motivation ard resources tb engage in these informal 
leamirg activities. However, the evidence ^is less than clear-cut. As will 
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be discussed later, some have argued that, for all students, achievement 
suffers an absolute decline over the summer, while other evidence suggests 
that CE students suffer a loss relative to regular students. It has been 
further suggested that, among CE students, those who achieve the highest gains 
during the regular school year suffer the sharpest losses during the summer. 

Based on these ideas, it has been suggested that summer school has an unusually 
important role to play. It has been argued that some CE students have regular 
school-year learning experiences which enable than to achieve exceptionally 
high gains, and that it is important that efforts be made to continue this 
high rate of achievement, sunnier sch|>ol seeming like a reasonable way of doing 
it. Since summer school classes are available to only about half of all stu- 
dents, it has been argued that cheir availability should be increased, parti- 
cularly for CE students. 

The r emai nder of this chapter examines these ideas. Pirst, we will discuss 
the extent to which there is a"susmer drop-off " and then we will consider 
the availability and effectiveness of summer school. 

THE NATURE OF ACHIEVEMENT GROWTH OVER THS SUMMER 

In a 1972 review of the effectiveness of sunnier compensatory education, Austin, 
Rogers and Waibeaser (1) conclude that students participating in CE suw^r 
programs show "modest achievement gains** However, they point < t!iat t** 
studies reviewed generally had no control groups, and it is possible that 
•maturation" could account for the gains reported. The saute review indicated 
that ol principals and teaokers believed summr school to be an effective 
learning experience. However, starting in 1976 the Stanford Research Insti- 
tute's ;JRI) Educational Policy Research .Center issued a series of reports 
that raised questions about whether or not there was any maturation over the 
s umme r and whether ofc not there were ccmparable growth changes for regular and 
CE students. Ttieir studies wert, done within the context of studying the proffer 
period for evaluating CE programs. It wns argued that evaluations based on 
fall - o-spring achievement gains were less than adequate because there were 
significant changes during the summer* Thus CE students who showed impressive 
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gains during the fall-to-spring time period might lose much of the gain during 
the summer. If this were the case, it was argued, then the proper period for 
evaluation was from the fall of one year to the fall of the next year. 

The series of SRI reports raised serious questions that influenced policy 
regarding whethei the federal government was appropriately evaluating its CE- 
funded programs, as well as whether it should support efforts to increase 
federal funds available to summer programs. In light of the significant impact 
the SRI results were having, it was important to examine the *>ES data base 
relative to summer achievement change. 

Is There an Absolute Summer Loss? 

As we have already discussed, it was generally assumed that there should be 
some relatively modest gains over the summer. Jest publishers assume a one- 
month summer growth, and the literature generally supported a summer gain. 
Thomas, and Pelavin say, "However, existing research suggests that the dis- 
advantaged student ha? no gain or a one-month loss over the summer" (19). It 
was suggested that CSE students were given particularly .intensive instruction 
during the regular school year and thus showed very significant growth. But 
this growth was thought to be ephemeral and much of it was lost during the 
summer. Thus CE students who had gained more than regular students during 
the regular school year lost more than regular students during the summer, 
» »nd ended up the following fall further behind the regular students than they 
had been the previous £-11. However, the 1976 SRI report' wa% 'based on a com- 
pilation of state ESEA Title I evaluation reports and the data were admittedly 
xess than satisfactory. 1 

■» « 

In 1977 Pelavin and David (16) published a report based on longitudinal data. 
\they obtained data from a midwestern city, known as "City M, M which had fall, 
spring, and ensuing fall teat results on the Gates-MacGinitie reading test for 
a moderate number of CE students. The results are shown in Table VIII-1. 
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Table VIII-1 

H City M" Grade Equivalent Means for Reading for Students 
with at Least Three Consecutive Test Points* _ 



Grade 


N 


Fall 


Spring 


Fall 


3 


272 


2.23 


3.29 


2.78 


4 


931 


2.65 


3.58 • 


3.18 


5 


980 


3.23 


4.30 


4.01 


6 


316 


3.84 


4.78 


4.42 


7. 


128 


4.35 


5.25 


4.95 : 



•Adapted from Pelavin and David (16), Table 1. 

Similar results v«re available for two successive years. While the number of 
case* shrank considerably, the results were 'similar, with each fall grade-equiv- 
alent mean considerably below the mean for the preceding spring. They also 
report results for two California junior high schools participating in the 
Demonstration Programs in -intensive Instruction. The number of cases is quite 
small (from 47 to 153) and the results are reported in (often misleading} grade 
equivalents. Again, students were followed longitudinally for two years. Of 
six coaparisons for reading, five showed sutmer losses and one a gain; for 
math, five showed losses and one no change. From these results they believe 
that . . achievement gains made during the school year are not sustained, 
even until the nexij fall*-, and say: £ 

"in conclusion, we urge that districts administer achievement tests 
minimally each fall and preferably each fall and spring. These 
data would provide the capability for estimating the extent to 
which school year gains are sustained through the following summer. 
Both fall and spring tests have added advantage of allowing a 
separation of school-year and suammr achievement. Although this 
information is not critical for estWtes of annual gains, it is 
valuable for studying the extent and causes of summer losses. If, 
for example, the phenomenon is a function of the measures used, 
the standardized achievement tests, one would want to change the 
measures not the program. If it 9 is a result bf instructional 
techniques that mitigate against retention, then the techniques 
should be changed. Since there are no simple solutions (for ex- 
asy le, there is little research to support the notion that summer 
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school would alleviate the summer losses), it is important to 
be able to determine why the losses occur in order to develop 
appropriate remedies." Y 

These results received wide attention in the government and became known as 
the " summer drop-off phenomena." There are a number of reservations that can 
be mkde about the studies, which are discussed in Report #8. 



In view of. the somewhat unexpected results from Che SRI study, others have in- 
vestigated the summer drop-off phenomena. Recently, Hammond and Frechtling 
(5) reported on the. results f ronr a special study of the NIE Instructional* 
Dimensions Study. 'Their restilfcs are shown in Table VIII-2. 

* A , Table VIII-2 

Grade Equivalent; Mean Achievement Gain Scores for GE Students* 



Reading 




N 


Fall-to- 
Spring Gains 


Spsing-to- 
Fall Gains 




Fall-to 
F#ll Gains 


• 

Grade 


1 


395 


1*2 


0.6 




1.2 


Grade 


3 


56S 


0.7 


0.2 




0.9 


Math 














Grade 


1 . 


143 


1.0 . 


0.1 




1.1 ' 


Grade 


3 


314 


1.2 


0.0 




.1.2 



* Adapted from Harihnond and Frechtling (5) , Table 1. 

These results show no sunnier losses, and show summer gains in two of the four 
comparisons*. Clearly these results are in contrast to the Pelavin and David 
findings of summer loss. Again, however, the results are based on a moderate 
number of cases, although it is said that the sample was representative of 
the original saiple, which was "/ . . purposively selected for their instruc- 
tional features." The authors point out that the sample carihot be considered 
representative of Title I reading and math programs. 
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Heyns (7) studied summef school achievement changes in Atlanta, Georgia. She 

reports that Atlanta ^has a particularly vigorous summer school program. As a 

> 

part of the study she analyzed data collected by the Atlanta school system, 
.which is relevant to the sdhmer loss question. Table VLII-3 shows typical 
results. 

Table VIII-3 

Mean Raw Scores in Basic Subjects by Test Dates and Subject Subtest.* 
' (N - 739 , 7th Grade) 



1 




_J3ati"of Test- 




Subject Subtest: 


Fall 127 v,_^ 


Sprijcjj-1971 


Fall 1971 


1. Word knowledge 


17.3 


21.9 


22.8 


*2 Reading 


15.3 

< 


1775 4 


18.0 


3. Liinguag? 


35.6 


39.7 


41.3* 


4. * Lfinguage. Study Skills 


4 

9.4 


11.6 


12.2 


5. Arithmetic Computation 


12.7 


17,4 


17.2 


6. Arithmetic Problem Solving 


15.6 


18.8 

4 


19.5.. 



♦Adapted from Heyns' Table 2.3 



The table shows that there are g^ins over the summer in all of the * reading- 
related rttotests. In the math area there is a email loss in one subtest and 

a larger gain in the other. Heyns presents data from several other grades 

^ - 

which show similar results. These data have the advantage of being based on 
raw scores and thus there is no scaling problem. They have the "disadvantage * 
of involving only s small mlnber of aJrl Atlanta students and represent only 
one city. Neverthele* j , they dg not show the marked ' susmer loss, reported by 

SRI. , 

SSS Report #8 contains data relevant to this issue. While the sample is not 

4 . 

precisely representative of the nation's schools, it is close to a representa- 
tive sample and includes large numbers of both regular ahd CE s tud e nts* — - — 

Figures 10- L and 10-2 sh&w t}ie. longitudinal achievement scores for a group of 
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about 39,000 students for the fall of 1976 , the spring of 1977, and the fall 
of 1977. The number of students ranges from 7133 to 8412 per cohort.^ One 
can see rates of growth during the regular school year and compare them with 
ie.'3ls of achievement in the subsequent fall.* Figure VIII-1 shows that, in 
reading, students continue to grow over the summer Snd, for the higher grades, 
at a rate which approximates the 'growth duri ng the regular school year. The 

.figure further shows that in reading there is an absolute gain over the sumer. 
Figure - VII 1-2, shows the results for math* However, the change over the summer 
is different than for reading and, on the a vera ge , shows -oniy^mal^r^igJuLns* 1 
gains in four comparisons and a loss in one comparison. It can be suggested 
that students get much more opportunity to practice reading in their everyday 
lives than they do to practice math* This is particularly true in thg higher 
grade's, and thus the rate of gain in reading during the summer approximates 

ithe rate for the regular school year. Finally, it seems clear that in these 
data there is not an absolute summer drop^ott, instead, there is an overall 
gain* The data from the SES are of much higher quality than that available 
to Pe lav in. and David, and as mentioned, their data 'have a number of potential 
deficiencies. In contrast, the SES bate were specifically collected for the 
study, were administered under known, controlled conditions, were based on 
large numbers of quite representative students, and the vertical ^cale scores 
are based on fall and spring testing points. In view of the results obtained , 
and their congruence with the SXE and Heyns data, we believe there is ^almost 
certainly an absolute reading gain over the sumer, and that there is a similar, 
but smaller, absolute gain in math. 

6 
% 

Is There a Relative Summer Loss? 

Next it was suggested that there was a relative loss, namely that CE ^students 
showed more of an achievement loss than regular students . David and Relavin 
(3) suggest this is the case and say (p. 4): 



"Strictly, these scores are not for the "simmer." Tests were administered 
about four weeks "before school ended and about 3 weeks after it started « 
Report aft ri4« r *i«tt*o *ih*fr igg llgm fcioRs this say h a v o j b ut it should be Tiotpd "~ 
that this same characteristic is true of all the data reported by Pelavin 
and David, "by iUumnond and Frechtling, and by Heyns. 
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"These studies, while extremely limited, present son* evidence that 
disadvantaged students achieve at a slower rate thanf expected over 
the sunner. Both conventional wisdom and the standardization pro- 
cedure of achievement tests assume that the rate of achievement for 
all students is slower during the summer than during the school year. 
This pattern of achievement is presumed to be tfce same for both ad- 
vantaged and disadvantaged students: all students are assumed to 
gain over the nvmmmx but at a slower rate than over th^ school year. 
The studies cited above suggest that this is not the case for disad- 
vantaged students. In fact, disadvantaged students may have no gain 
over the sumner or may even lose.* 



Vhey then review their previous work and jay, -"Together, these findings suggest 
that large achievement gains produced by compensatory-education programs over 
the school year may be followed by corresponding achievement losses over the 
ii— n - oavid and Pelavin reexamine the data they r^fcrted previously and 
also include new data from the Alum Rock Voucher Study. The Alum Rock reading 
results show wwmnv gains for three grades and nd change for four grades. They 
conclude by saying, "Combined with questions raised by previous research, such 
as inconsistencies between school-year evaluation results and the results of 
annual state-wide testing programs, We suspect that the existence of summer 
losses is quite comon for educationally disadvantaged students." 

4 

Again the HIE data are relevant. Table V1II-4 shows data for students who were 
above the 50th percentile and not recieving OB, and students who were below the 
50i h percentile and receiving OS. 



Regarding tjies* results, Hammond and Frechtling says "When CI students whose 
pretest scores fall below the fiftieth percentile were cos^arad to non-CE stu- 
dents whose pretest scores westo at or above the fiftieth percentile, the low 



achievers lost ground over tbf susmwr to the high achievers. The difference 
was statistically signf leant, however, only for the f^st grade. On a twelve- 
month basis th- low achievers maintained^ their position relative to the high 
achievers because the «CE students had higher rates of gain during the school 
year." Thars are ssveraiTpraswlintf things about these data— p art icularly the 
w ide variatio n i n gains. It seems pe culiar that non-CE first graders gained 
only 0.5 grade equivalents in bo& reading and math during tl a school year; 



Table III-4 



Abov 



Mean Grade Equivalent Scores for Non-CE Students ^bove the 50th 
Percentile and CE Students Below the 50th Pejrcefntile* 





Reading 


N 


Fall-to-Spring 
Gain? 


Spring-to-Fall 
Gains 


Fall-to-Fall 
Gains 




Grade 1 












won— ce b t^Kien t s 
CE Students 


344 


0 5 
1.2 


b i 
7 0.0 


0.6 

ih - ' 

a* 




Grade j 












Non-CE Students 


305 


1.0 


0.6 


1.6 




CE Students 


512 


0.5 


0.3 


-0.8 


- 

0 


Math 
Grade 1 








- 

/ 

/ 
/ 




Non-CE Students 


435 


oTs 7 


o7l r 


/ 

0.6 




CE Students 


97 


i.i 


0.1 


1*2 




Grade 3 




\ 








Non-CE Students 


178 


1.6 


0.2 


* 1.8 7/1 1 




CE Students 


306 


1.2 


0.1 


1.1 , 


* Adapted from Hamo&nd and Frechtling, Table 


2. • 





similarly, why did the 3rd-grade CE reading students gain only 0.5 grade 
equivalents in reading but 1.2 grade equivalents in math? We believe that 
these data are equivocal regarding the existence of a relative summer loss 
for CE students. 



The SES has extensive data on this problem* We can use the same data as pre- 



sented before on the absolute summer drop-off question, but break it into two 
groups—those receiving CE and those not receiving CE. Figures VIII- 3 and 
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III-4 show the results for reading and for math. The number of cases for 
reading varies from 1477' to 2344 for CE students and from 5400 to 6131 for 
non-CE students. .The corresponding numbers for math axe 1115 to 1499 and 6132 
to' 7061. It will be noted that for the non-CE students in reading there is a - 
lessening in the rates of growth over the summer for the lower grade cohorts j 
but very little, if any, for the higher grades. For the CE students there is 
a similar lessening In ,«e lower grades, but, considering their slightly slower 
rates, of growth during the regular school year, there may be a slight summeir 
gain relative to non-CE students ^ In the higher grades the CE students in 
•"reading drop 'off slightly more than their non-CE peers. For math the picture 
Is somewhat different. Both the CE aM non-CE students, show a lessening in 
rates of growth over the summeir {or all grade cohorts. The change for CE and 
non-CE students is very similar with, perhaps, a slightly larger drop for the 
non-CE students . Since the graphs have a number of overlapping lines and many 
may be difficult to follow, the same results are shown numerically in Table 



VIII-5. In evaluating these summer ch4no*ea it should be remembered that the 
standard deviation of a vertical scale score is about 50, It is our position 
that there may be a very slight, overall relative summer drop for CE students 
in reading, but not in math. Because of the very laxge number of cases in- 
volved in eac \ comparison it is possible to show a few statistically signifi- 
cant changes, but from a practical point of view the data do not support the 
idea of any important loss for CE students relative to their non-CE peers. 
Neither the SIRS data nor the HIS data give credence to any large or particu- 
larly significant relative summer loss. 



Over the j 



ments than do 



r, to High Achievers Lose More than low Achievers? 



/ 



It has been stages ted that CE students who are high achievers are the ones 
who lose the i»st during the summer. Abhievement is defined here as the '/ 
achievement iiivel of the student, not the gain during the school year —which 
will be considered in the next section, it is thought by some that students 
with good aca< iemic potential profit from the increased services afforded by 
CE instruction, but that during the summer they are again placed in ax/ im- 



poverished intellectual environment and lose more of the school-year /achieve- 



non-CE students, whqlenjoy superior summer environment 



It is 
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Table VIII-5 

Summer Gain Scores for CE and Non-CE Students . 
(Vertical Scale Scores) 



Cohort 

CE Status 



Spriqg 1977 Fall 1978 

* Reading . 



Summer Change 



Cohort 1-2 
CE 

Non-CE 



385 
416 



391 
.427 



* 6 
11 



Cohort 2-3 
CE 

Non-CE 



428 
468 



433 
476 



5 
8 



Cohort 3-4 
CE 

Non-CE 



455 
507 



456 
518 



1 
11 



Cohort 4-5 
CE 



Non-CE 



474 

334" 



477 « 



3 
9 



Cohort 5-6 
CE 

Non-CE 



497 
561 



501 
571 



4 

10 



Math 



Cohort 1-2 
CE 

Non-CE 

Cohort 2-3 
CE 

Non-CE 




Cohort 4-5 
CE 

Non-CE 



376 
395 



421 
451 



469 
505 



502 
552 



377 
400 



426 
451 



506 



501 
547 



1 

5 



5 
0 



-1 



Cohort 



CE 

Non-CE 



539_ 
591 



~543 

592 — 
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further suggested that children who are lew achievers gain relatively little 
during the regular school year, and likewise lose relatively little during 
the Sumner. 

The graphical presentation here is more complicated than in the previous graphs 
because for each cohort two concepts are presented simultaneously, namely, 
CE status and level of achievement. Level of achievement was defined as the 
average of the faU and spring (recommended level) test scores for the previous 
school year. This averaging was done to achieve as much stability as possible 
in specifying the level.of achievement for ear* child. The graphs show the 
results for the first quartile, that is, the quarter of students having the 
lowest achievement test scores, and for the third quartile. The third quar- 
tile was selected rather than the fourth quartile for two reasons. First, the 
number of cases of CE students in the fourth quartile, by grade cohort, became 
quite small and the results were rather unstable. Second, the fourth quartile 
results, while unstable, were consistent with those for the third quartile 
where the number of cases was reasonably large (not less than 114 for the 
smallest cell-by-cohort, by CE status). T abls VIH - 0 shows Um yai5r *nd-~~~~~~" 
losses in achievement, test scores over the summer for students iff the first 



and third achievement quartiles. Figures VIII-5 and VTII-6 are quite compli- 
cated but are included here because they show the Easic growth data for the 
school year and the summer. A number of interesting results follow from these 
data: 

1) For reading, the growth rata for the first quartile during 
the school year is quite similar for each cohort and between 
cohorts, and the growth continues at approximately the same 
rate over the summer. A portion of the measured summer growth 
is undoubtedly* due to regression, but, surprisingly, the amount 
of (growth and/or regression is similar for both CE and non- 
CE students. . . 



2) For reading, the rate of growth of third quartile students 
during the school year is considerably higher than^ that for 
first quartile students. There is a tendency during the 
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Table VI I I -6 



Changes in Test Scores Over the Summer for Low- and 
High-Achieving Students by CE -Status • 



X/ 



Cohort 




CE-fil 


Non-CE-Ql 
Reading 


CE-Q3 


Non-CE~Q3 




1-2 




11 


16 


3 


13 




2-3 




8 


13 


0 


7 




3-4 




3 . 


10 


-1 


13 




4-5 




6 


11 


-4 


6 




5-6 




7 


8 


-3 


11 


- 






16 


Math - 

2i 


9 


e 




1- 2 

2- 3 




' 7 


7 


-4 


7 




3-4 




9 


. 9 


-9 


1 




4-5 




9 


9 


-12 


-9 




5-6 




12 


15 


-5 


-1 





ERIC 



regular school year for CE students to grow at a higher rate -ji 

than non-CE students. 

X 

Over the sunnier, third quartile non-CE students continue to grow, 



while, particularly for the higher grade „ cohorts, the third quar- 
tile CE students show a loss - : The third quartile students should 
show less regression Xowardthe mean than first quartile students, 
but there should still be some regression for third quartile stu- 
dents. In spite of this, non-CE students continue to grow over 
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Figure VIII-5. Reading Achievement toy CE Statu* art 
Qmartile of Achievement Level 
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Figure VIII-6, Math Achlevcja^nt by CE Status and 
Quartile of Achievement Level 
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the s umme r* Certainly for reading, the CE students in the third 
quartile show a relative loss, while the first quartile CE stu- 
dents do not — rather they show about the same gain as first 
quartile non-CE students* 

3) , For math, the first quartile students flkhave in much the sane 

way as they do for reading; that is, they have gains over the 
sinner fehat are about the sane as school year gains, and there 
is little difference between CE and non-CE students. 

4) For math, for the third quartile students, the picture is 
somewhat different than it if for reading. Again the third 
quartile students grow at' a more rapid rate than first quar- 
tile students, but both CE and non-CE math students show losses 
over the summer. Also, there is evidence that the CE students 
lose at a greater rate than the non-CE students* but the dif- 



ference is not as great as for reading 




From the above we conclude that low-achieving sfucisnrs Mini Inrt t-n gr pw ° v * ar 



the summer and at about the same rate as during the school year, and therp is 
no significant difference between CE and non-CE students. On the other hand, 

high-achieving students grow at a higher rate during the school year* For 

• — . 

reading, non-CE high-achieving students continue to grow over the summer, but 
CE students show a loss, arid a relative 4oss.~ -For math, Aoth CE and non-CE 
high-achieving students show a loss over the summer, but the CE students show 
a larger loss. 

Just how important this relative loss for high-achieving students is depends 
upon where the emphasis for CZ resources should be placed, there are about 
six times as many (X students below the median in achievement as there are 
above it. If the goal is to help the vast majority of CT students, can one 
justify allocating •reap^nnai resources to high-achieving CE students on the 
grounds that they lose more over the summer than *heir non-CE peers? On the 
other hand, low-achieviiig CE students gain over the suamer. Perhaps they 
would gain more if they had special summer services. 
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Over the Summer ,' Do High Gainers Lose More than Low Gainers? 

The final variation on the summer los% question revolves around. the relative 
loss of high and low gainers. It has been argued that during the regular 
school year, particularly for CE students, those who gain an exceptional amount 
lose the gain during K the summer. It is thought that these students need the 
stimulation of intensive instruction to achieve these gains and tftat lacking 
such stimulation 0 over the summer they lose more than those achieving smaller 
gains. 



First, we studied the gains and losses of individual Title I students who had 
experienced the largest and the smallest gains during the regular school year. 
The students were divided into four equal -sized groups based on the amount of 
gain experienced from the fall to spring in the regular school year. Then 
the arount of summer gain or loss associated with each group was determined. 
Table VIII-7 shows the results* 



Those students having the highest measured gains during the schcx5B%ear show 
quite sizable losses over the summer. On the other hand, those students s|^r- 
ing the lowest gains during the school year show equally large gains over the 
summer. These data are an almost perfect example of the regression- toward- 
the -mean phenomenon. It is well Mown that test scores at the extremes of 4 
distribution are less reliable than those near the mean. Gain scores are 
generally less reliable than individual test scores, and thus even more subject 
to regression. As would be predicted by regression effects, those students 
who show very little galxu4u£ing the school year show a relatively la^ge gain 
ove "the summer, while those students showing high gains during the school year 
show relatively large losses over the summer These gains and looses are 
almost certainly artifacts attributable to measurement errdr and show how " 
difficult it is to generalize about a trend unless both gilds of the distribu- 
tion are considered (or one has extremely reliable measures) . 
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Table^VIII-7 

Mean Spring 1978 to Fall =1978 Test Score <VSS) Changes for Title I 
Students by Quarter of Achievement Gain in the 1976-77 School Year 



Cohort 


Total Nunb«r 
of Students 


Quarter of 1976-77 School Year 


Gain 


Lowest 


Second 


liUltt 


Highest 






Reading 








1-2 


1583 


22 


2 


l 


-8 


2-3 


1606 


V * • 


7 

f 


2 


-12 


3-4 


1646 


18 


2 


-4 


-16 


4-5 


1303 


22 


6 


-5 


-19 


5-6 


1066, 


23 


11 


1 


-12 






Math 




• 




1-2 


854 


22 


5 


-9 


-24 


2-3 . 


864 


30 


10 


-3 


-18. 


3-4 


1023 , 


17 


0 


-9 


-24 


4-5 


850 


22 


1 


-11 


-27 


5-6 


758 


24 


8 


0 


• -22 



There ia still the possibility that students associated with the sore success- 
ful « projects experience greater losses than those in less successful projects. 
To investigate this possibility we determined the gains over the school year for 
each grade in each school that contained Title 1 students. With the SES data we 
were not able to associate each student with a particular "project" (which is a 
very hard to define entity In actual school practice) , but since particular 
grades having Title I students were a well defined unit, where the Title I etu-* 
dents were probably receiving quite simitar instruction, we used grade in lieu 
of project. The regular school year gain of each student in a grade was deter- 
mined and free, it the average grade gain was computed. Again, there were four 
equal groups of grades formed, depending on the average gain of the students in 
^gradi^ Table VIII-8 shows the gains and losses associated with each group of grades 
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Table VIII-8 

Mean Spring 1978 to Fall 1978 Test Score. (VSS) Changes by 
Four Levels of 'Project 1 f 976-77 School Year Gains 





Average Number 
of Students at 
Each- Quarter of 
•Project" Gain 


Quarter of 


' Project ' 


School-Year Gains 
• 


Cohort 


Lowest . Second 


Third 


Highest 


* 




Reading 






'- 


i— * 


375 


i2 


6 


2 


- 0 


• 


J4b 


8 


1 


10 

<- 


-2 






9 


2 


0 


.-9 


4-5 


277 * 


.4 % V 


7 


2 


-7 


5-6 


223 


8 

Math 


7 


4 


2 


1-2 


186 n 


9 


0 


-2 


-9 


2-3 


190 


17 


13 


-5 


-9 


3-4 
« ♦ 


232 


-4 


-1 


1 


-11 


4-5 


181 


1 


2 


-9 


-9 


5-6 


156 


13 


11 


0 


-7 



Again We see the same trends that were seen for individual students.. Grades are 

* 

made ^up of studer .s having a considerable aispersion in their scores and thus, 
on the average, we would expect less regression towards* the mean when grade 
averages are Used for categorization rather than individual scores. Also, <$roup 
data are more reliable than individual data and thus there is less change It 
can be seen that those grades whose students had high* gains during the regular 
school year had losses over the summer, while those grades whose students had 
low gains over the school year had summer gains which were similar to the losses 
of the high-gain group. As before, the results are almost certainly artif actual. 
It is our conclusion from these data that high-gainers do not really experience 
losses over the summer, nor do low gainers really experience unusual gains over 
the summer. 




From tljis wealth of data we conclude that there i s no absolute summer drop-of f , 
But that th^re inay be a Slight, but not particularly significant, relative loss 
for CE students' in comparison to non-CE students. The more detailed analyses of 
high and low gainers, and of members of high-gain an4 low-gain projects, lead 
us to believe that reported relative summer drop-off is more of a measurement 
artifact^than a reality* 

SUMMER SCHOOL A^D ITS EFFECTIVENESS 

The place of summer school in the general scheme of elementary education is not 
well defined. Some have suggested that students who have not performed well 
during the regular school year should go to summer school as an additional learn- 
ing experience that would help them in the coming school year. It has been 
thought that th^s might be particularly important for CE students who are having 
difficulty in keeping up with their peers* Also,^if high-achieving CE students • 
lost a large amount of their school-year gain, it would be particularly impor- * 
, cant that they attend sunoer school to help mitigate such losses. Of course, 
sumner school serves functions in addition to instruction in basic subjects. 
There are recreational and special-interest classes that many students find 
attractive* Summer school can also carve as a safe haven for. children whose 
mothers are working or need to be away from the home* Summer school serves 
many purposes in addition to instruction in reading and Math. 

^ ' / 

What Is .Sumner School and How Available Is It? 9 / 

In the SES, we surveyed the principals of 52 summer schools in the second-year 
SES sample* The average length of these suoner schools was five to six weeks, 
which means 25 to 30 school days/ There were slight tendencies for large dis- 
tricts to offer a few more days of instruction than for small ^distsicts, and 
for medium-poverty districts to offer a few more days of school than high- or 
low-poverty districts* But these trends were slight and it is appropriate to 
think of summer school as lasting five or six weeks (see Table 3-12, Report #8). 
The amount of reading and math instruction is not large. On the average there \ 
fre- about 17 hours of reading instruction and about 14 hours of math instruction. 
There is no difference in the amount of instruction as grade level increases, 
nor do Title I students receive more instruction than others (see Table 3-15, 
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Report #8). tfowever, there is a clear tendency for CE students to attend summer 
^school more tnan non-CE students* By grade cohort, the percentage of CE students 
who attend ranges from 2_ to 32, while the percentage of non-CE students v who 
attend ranges from 7 to 20. In terms of teachefs' judgments of need for CE ser- 
vices, twice the percentage of 'needy 1 students attend summer school than the\^^ 
• not needy. 1 In terms of achievement test scores, those attending summer school 
score considerably lower then" tnose not attending, and this is true both among 
CE students and noh-CE students (jee Table 3-7 and D-l through D-5, Report '#8). 

About half of all students have summer ^chool available either at their regular^ 

year school or elsewhere in the district, rfith larger schools more frequently 

t i * % % - 

having summer school. There is a slight tendency tcr schools having high con- 
centrations of minority students to have summer school more frequently. About 
two- thirds of all summer schools are supported by Title 7 funds, but only a 
quarter are completely supported by Title I funds. 

The previous figures are all derived from the SES study and they are quite con- 
sistent with other reports. David (4) intensively studied the Title I stammer 
programs in three states, and she found that "The programs average five or six 
weeks in length and generally run two to four hours per day." She reports that 
fewer than 15 percent of all ritle I districts have Title I summer programs. Ac 
first glance tiiis appears inconsistent with our findings that about half of all 
students have summer school available. It must be remembered that there are many 
small and rural districts and tttrt^frhirr ii n 'tendency fnr large schools in large 
districts to have summer school more frequently. She also reports "...that the 
summer school program tends to be Staffed by non-Title I teachei \ result? 

ing in a staff unfamiliar with participating students." She repor. it per- 
sonnel believe summer school to be sademically effective, but also points out 
that she has no objective data to -support such a supposition., We havefalreafdy 
cited Austin, Rogers and Walbesser 's fc (1) review of summed studies. They come 
to the same, conclusion. 1 
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How Effective Is Summer v jrQhool ? 

^In judging the effectiveness of summer school it is not sufficient to show that 
students who attend summer school increase their performances over the summer. 
To measure the effectiveness of summer school , one must compare students who 
attended summer school with similar students who did not attend. 

Figure VI II- 7 shows the reading growth of summer school attendees and non-attendees 
for the regular school year and for the sunmer, while Figure VI 1 1- 8 shows the 
same material lor math. These curves show that, for reading, both attendees and 
non-attendees continue to grow over the summer, and also that the summer growth 
for the two groups is similar. For math, there is growth over the summer in tl 
lower grades but a leveling off or decline in the higher grades, but again there 
is no greater achievement for those who attended summer school. 

These figures lump GE and non-CE students together* It can be argued that, over 
the suauer, CE students may perform differently. Figures VII 1-9 and VIII-10 
show a comparison between CE students who did and didn't attend summer school. 
For reading it should be noted that in the first two grades the attendees and 
non-attendees start the school year quite close together, while in the higher 
grade cohorts the attendees are the lower achievers* Almost all groups gain 
over the summer; the attendees do not gain more than the non-attendees. While 
at first glance one may think there is a trend for attendees to gain more — for 
example for cohort 1-2— it is contradicted by another cohort— like 2-3. For 
reading there is no statistically significant advantage as a result of attending 
sumer school. For math there is a suggestion that those who attend summer 
school gain more than those who do not, but the trend is not statistically sig- 
nificant* 

The previous data can be criticized on the grounds that attendance at summer 
school is voluntary, and that when volunteers aw compared with non-volunteers 
from the same school a biasing element is introduced* It can be seen from 
Figures VIII-7 and VIII-8 that it is the lower-achieving students who attend 
sumer school and it can be argued from the evidence in Figures- VIII- 5 and VIIJ-6 
that lower- achieving students will seem to gain more ttian higher-achiaving students 
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Figure VIII-9. Beading Scores for CE Students Who Attended 
and Did Not Attend Summer School 
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due to regression effects. In an effort to overcome some of these possible 
limitations in the analysis, another comparison group was formed* Title I stu- 
dents from schools that did not have summer school available were compared to 
students^ from Title I schools offering summer school. The groups of students 
were matched on initial levels of achievement. Thus two groups were formed that 
were matched on achievement and on being Title I students, but one group attended 
while the other could not actend summer school. Again the statistical tests 
showed no significant difference in growth between those who attended and those 
who did not* 

All the analyses from the SES data discourage ^he idea that summer school, as 
it is now conducted, is an effective mechanism \f or improving the performances of 
C£ students. 

As we conpare students who attended summer schools with those who did not, we 
singly find that present summer schools are not effective in raising basic- 
achievement test scores. But what rffect should fc?. reasonably expected from 
four or five weeks of instruction of less than an hour a day for reading or math? 
When children are rapidly maturing in their reading skills and can have summer 
reading ^experiences without sumer school, should we expect, summer- school- related 
reading gains? In the data there is a hint that summer school in the higher 
grades may be effective in math, and, in comparison to reading, there is less 
summer growth in math in higher grades* Probably there is less opportunity for 
math-related experiences during the sinner. We should not extrapolate these 
results by concluding that summer school cannot be effective. If summer school 
were longer and had more hours per day devoted to basic subjects, it might re- 
sult iii achievement gains for attendees— but that is still to be demonstrated. 
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